00000040:00080000:1.0F:1788813315.111836:0:17196:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788813315.111853:0:17196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813315.111889:0:17196:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788813315.111899:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0F:1788813315.492061:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813316.452409:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313384832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813316.452468:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0F:1788813316.452650:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313384832 00000100:00100000:2.0:1788813316.452670:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313384832 00000100:00100000:2.0:1788813316.452726:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788813316.452736:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313384832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788813316.452765:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788813316.452813:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313384832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813316.452818:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788813316.452868:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0F:1788813316.452987:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313384832:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788813316.520196:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788813316.967685:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:3.0:1788813316.967707:0:17142:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff948a6fe3e900 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:3.0:1788813316.967711:0:17142:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948a4523dc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff948a6fe3e9c0 00000020:00080000:3.0:1788813316.967714:0:17142:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948a4523d600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff948942f79c00 00000020:00080000:1.0:1788813316.971107:0:17202:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:1.0:1788813316.971205:0:17202:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788813316.971878:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff704378 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813316.971891:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff704378 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813316.971901:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff704378 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813316.971909:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813316.971914:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff704378 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813316.971922:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff704378 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813316.971975:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948a6aed9e00) 00010000:00010000:0.0:1788813316.971979:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813316.971984:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff704378 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813316.971991:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff704378 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788813316.988308:0:18665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1788813316.988326:0:18665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000040:00080000:2.0:1788813317.285241:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788813317.476297:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313384960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813317.476379:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813317.476443:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313384960 00000100:00100000:2.0:1788813317.476453:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313384960 00000100:00100000:2.0:1788813317.476515:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788813317.476524:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313384960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788813317.476558:0:17902:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788813317.476624:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313384960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813317.476631:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788813317.476688:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313384960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813317.484738:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313385088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813317.484813:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813317.485511:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313385088 00000100:00100000:2.0:1788813317.485521:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313385088 00000100:00100000:2.0:1788813317.485580:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788813317.485590:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313385088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813317.485632:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788813317.486216:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313385088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 626us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813317.486225:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788813317.486304:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313385088:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788813317.543132:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813317.694121:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813317.695156:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301791616 00000100:00100000:1.0:1788813317.695169:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301791616 00000100:00100000:1.0:1788813317.695247:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 74 00000100:00100000:1.0:1788813317.695259:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+12:15553:x1875706301791616:12345-192.168.202.13@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788813317.695383:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+12:15553:x1875706301791616:12345-192.168.202.13@tcp:60:lhsmtool_posix.0 Request processed in 127us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813317.695390:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 74 00000100:00080000:3.0:1788813317.695568:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813317.697453:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813317.697756:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301791744 00000100:00100000:3.0:1788813317.697766:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301791744 00000100:00100000:3.0:1788813317.697840:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 75 00000100:00100000:3.0:1788813317.697852:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:15553:x1875706301791744:12345-192.168.202.13@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788813317.699087:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:15553:x1875706301791744:12345-192.168.202.13@tcp:60:lhsmtool_posix.0 Request processed in 1229us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813317.699098:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 75 00000100:00080000:1.0:1788813317.700471:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788813317.707559:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813317.707634:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301792000 00000100:00100000:2.0:1788813317.707644:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301792000 00000100:00100000:2.0:1788813317.707708:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:2.0:1788813317.707720:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a453b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+12:15553:x1875706301792000:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788813317.708638:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a453b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+13:15553:x1875706301792000:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 917us (1081us total) trans 8589934636 rc 0/0 00000100:00100000:2.0:1788813317.708648:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 16 00010000:00010000:3.0:1788813318.565400:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813319.050653:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813319.050714:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813319.050782:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301792512 00000100:00100000:2.0:1788813319.050798:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301792512 00000100:00100000:3.0:1788813319.050880:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813319.050881:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 35 00000100:00100000:2.0:1788813319.050901:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2398:x1875706301792512:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813319.050968:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813319.051065:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301792128 00000100:00100000:1.0:1788813319.051069:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301792256 00000100:00100000:3.0:1788813319.051075:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301792128 00000100:00100000:1.0:1788813319.051078:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301792256 00000100:00100000:3.0:1788813319.051148:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 169 00000100:00100000:1.0:1788813319.051155:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301792384 00000100:00100000:1.0:1788813319.051160:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301792384 00000100:00100000:3.0:1788813319.051163:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:2398:x1875706301792128:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813319.051203:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:1.0:1788813319.051215:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+13:2398:x1875706301792256:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813319.051243:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:2398:x1875706301792128:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 81us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813319.051253:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 169 00000100:00100000:1.0:1788813319.051273:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+13:2398:x1875706301792256:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 56us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813319.051283:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:1.0:1788813319.051310:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 73 00000100:00100000:1.0:1788813319.051319:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2398:x1875706301792384:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813319.051352:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2398:x1875706301792384:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 34us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813319.051361:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 73 00000100:00080000:3.0:1788813319.051601:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813319.051633:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813319.051637:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813319.051649:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2398:x1875706301792512:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 751us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813319.051659:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 35 00000100:00100000:0.0:1788813319.057182:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813319.057232:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813319.057633:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301792640 00000100:00100000:2.0:1788813319.057645:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301792640 00000100:00100000:2.0:1788813319.057710:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301793024 00000100:00100000:2.0:1788813319.057713:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301793024 00000100:00100000:3.0:1788813319.062124:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813319.062157:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813319.062208:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301792768 00000100:00100000:3.0:1788813319.062218:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301792768 00000100:00100000:3.0:1788813319.062314:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301792896 00000100:00100000:3.0:1788813319.062318:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301792896 00000100:00100000:3.0:1788813319.062346:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 74 00000100:00100000:3.0:1788813319.062356:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342c3357-8551-4188-a7af-8af88d224192+6:2399:x1875706301792768:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813319.062429:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342c3357-8551-4188-a7af-8af88d224192+6:2399:x1875706301792768:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 73us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813319.062436:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 74 00000100:00100000:3.0:1788813319.062457:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 75 00000100:00100000:3.0:1788813319.062464:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342c3357-8551-4188-a7af-8af88d224192+5:2399:x1875706301792896:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813319.062501:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342c3357-8551-4188-a7af-8af88d224192+5:2399:x1875706301792896:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 37us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813319.062964:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 75 00000100:00100000:2.0:1788813319.063614:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:2.0:1788813319.063627:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2395:x1875706301792640:12345-192.168.202.13@tcp:9:kworker.0 00000020:00000080:2.0:1788813319.063651:0:18670:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff704037 00000100:00080000:2.0:1788813319.063668:0:18670:0:(import.c:65:import_set_state_nolock()) ffff948a7b56a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788813319.063713:0:18670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788813319.063861:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+2:2395:x1875706301792640:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 226us (6679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813319.063869:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:2.0:1788813319.063886:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:2.0:1788813319.063892:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342c3357-8551-4188-a7af-8af88d224192+5:2395:x1875706301793024:12345-192.168.202.13@tcp:9:kworker.0 00000020:00000080:2.0:1788813319.063905:0:18670:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff70406f 00000100:00080000:2.0:1788813319.063918:0:18670:0:(import.c:65:import_set_state_nolock()) ffff948a6e6df000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788813319.063959:0:18670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788813319.064029:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342c3357-8551-4188-a7af-8af88d224192+2:2395:x1875706301793024:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 136us (6796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813319.064037:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:0.0:1788813319.069044:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813319.069207:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301793152 00000100:00100000:0.0:1788813319.069218:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301793152 00000100:00100000:0.0:1788813319.069283:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 32 00000100:00100000:0.0:1788813319.069295:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:342c3357-8551-4188-a7af-8af88d224192+5:2395:x1875706301793152:12345-192.168.202.13@tcp:9:kworker.0 00000020:00000080:0.0:1788813319.069332:0:19191:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff704076 00000100:00080000:0.0:1788813319.069342:0:19191:0:(import.c:65:import_set_state_nolock()) ffff948a6e6dd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788813319.069387:0:19191:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788813319.069547:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:342c3357-8551-4188-a7af-8af88d224192+2:2395:x1875706301793152:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 254us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813319.069555:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 32 00010000:00010000:0.0:1788813319.069577:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788813319.069693:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788813319.069699:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813319.069702:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813319.069704:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788813319.069748:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813319.069765:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813319.524398:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313385216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813319.524492:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813319.524624:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313385216 00000100:00100000:3.0:1788813319.524633:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313385216 00000100:00100000:3.0:1788813319.524697:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813319.524708:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313385216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813319.524739:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788813319.524799:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313385216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813319.524806:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813319.524858:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313385216:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788813319.524967:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813319.525457:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313385344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813319.525502:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813319.525735:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313385728:0@lo:400:kworker.0 00000100:00100000:3.0:1788813319.525765:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813319.525782:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313386240:0@lo:400:kworker.0 00000100:00100000:3.0:1788813319.525804:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813319.525819:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313386752:0@lo:400:kworker.0 00000100:00100000:3.0:1788813319.525838:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813319.525854:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788813319.525859:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313385600:0@lo:400:kworker.0 00000100:00100000:3.0:1788813319.525880:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813319.525903:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313386112:0@lo:400:kworker.0 00000100:00100000:3.0:1788813319.525923:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813319.525961:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313386624:0@lo:400:kworker.0 00000100:00100000:3.0:1788813319.525981:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813319.526022:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313386240 00000100:00100000:3.0:1788813319.526028:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313386240 00000100:00100000:3.0:1788813319.526061:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313386752 00000100:00100000:3.0:1788813319.526064:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313386752 00000100:00100000:3.0:1788813319.526082:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313386624 00000100:00100000:3.0:1788813319.526085:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313386624 00000100:00100000:3.0:1788813319.526101:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788813319.526108:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313386240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813319.526150:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313386240:12345-0@lo:400:kworker.0 Request processed in 42us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813319.526156:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788813319.526173:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788813319.526181:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313386752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813319.526218:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313386752:12345-0@lo:400:kworker.0 Request processed in 39us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813319.526223:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788813319.526239:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788813319.526245:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313386624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813319.526269:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313386624:12345-0@lo:400:kworker.0 Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813319.526274:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788813319.526305:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313386624:0@lo:400:kworker.0 00000100:00100000:3.0:1788813319.526314:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313386240:0@lo:400:kworker.0 00010000:00080000:3.0:1788813319.526323:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894435ce00 x1875706313386752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813319.526333:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313386752:0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.526459:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313385728 00000100:00100000:0.0:1788813319.526463:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313385728 00000100:00100000:0.0:1788813319.526513:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313386112 00000100:00100000:0.0:1788813319.526517:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313386112 00000100:00100000:0.0:1788813319.526540:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788813319.526547:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313385728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.526586:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313385728:12345-0@lo:400:kworker.0 Request processed in 38us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813319.526600:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788813319.526613:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788813319.526619:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313386112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.526647:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313386112:12345-0@lo:400:kworker.0 Request processed in 29us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813319.526652:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788813319.526671:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313385600 00000100:00100000:0.0:1788813319.526674:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313385600 00000100:00100000:0.0:1788813319.526696:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788813319.526703:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313385600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.526732:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313385600:12345-0@lo:400:kworker.0 Request processed in 30us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813319.526738:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788813319.526766:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813319.526770:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813319.526772:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813319.526782:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313385856:0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.526806:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813319.526824:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313386368:0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.526842:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813319.526859:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788813319.526865:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313385472:0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.526889:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813319.526911:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313385984:0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.526956:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813319.526983:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313386496:0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.527006:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813319.527029:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313385472 00000100:00100000:0.0:1788813319.527033:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313385472 00000100:00100000:0.0:1788813319.527059:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788813319.527064:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+24:3627:x1875706313385472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.527095:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+24:3627:x1875706313385472:12345-0@lo:400:kworker.0 Request processed in 31us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813319.527101:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788813319.527126:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313385984 00000100:00100000:0.0:1788813319.527129:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313385984 00000100:00100000:0.0:1788813319.527148:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788813319.527154:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313385984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.527181:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313385984:12345-0@lo:400:kworker.0 Request processed in 27us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813319.527186:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788813319.527205:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313385856 00000100:00100000:0.0:1788813319.527208:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313385856 00000100:00100000:0.0:1788813319.527227:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313386368 00000100:00100000:0.0:1788813319.527229:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313386368 00000100:00100000:0.0:1788813319.527247:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313386496 00000100:00100000:0.0:1788813319.527250:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313386496 00000100:00100000:0.0:1788813319.527264:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788813319.527269:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313385856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.527296:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313385856:12345-0@lo:400:kworker.0 Request processed in 27us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813319.527301:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788813319.527312:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788813319.527323:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313386368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.527350:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313386368:12345-0@lo:400:kworker.0 Request processed in 28us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813319.527356:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788813319.527386:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788813319.527391:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313386496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.527418:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313386496:12345-0@lo:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813319.527423:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1788813319.527441:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788813319.527444:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813319.527464:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313385472:0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.527484:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313385984:0@lo:400:kworker.0 00010000:00080000:0.0:1788813319.527495:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894435d180 x1875706313386496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813319.527503:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313386496:0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.527512:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313385856:0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.527520:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313386368:0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.527553:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313385600:0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.527563:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313386112:0@lo:400:kworker.0 00000100:00100000:0.0:1788813319.527572:0:3626:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1788813319.527577:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94894334d880, transno 8589934596 00000004:00080000:0.0:1788813319.527588:0:3626:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1788813319.527608:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313385728:0@lo:400:kworker.0 00000100:00100000:2.0:1788813319.527829:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313385344 00000100:00100000:2.0:1788813319.527834:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313385344 00000100:00100000:2.0:1788813319.527878:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788813319.527885:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313385344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813319.527902:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788813319.527962:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313385344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (2460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813319.527969:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788813319.528838:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313385344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813319.528895:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313386880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813319.528949:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813319.529030:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313386880 00000100:00100000:2.0:1788813319.529035:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313386880 00000100:00100000:2.0:1788813319.529069:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788813319.529077:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313386880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813319.529098:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788813319.529142:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313386880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813319.529149:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788813319.529178:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313386880:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788813319.529826:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788813319.589089:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788813319.692598:0:20539:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 16:35:19 (1788813319) 00010000:00010000:0.0:1788813320.613108:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813321.572320:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813321.572342:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313387008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813321.572409:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813321.572573:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313387008 00000100:00100000:2.0:1788813321.572581:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313387008 00000100:00100000:2.0:1788813321.572646:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788813321.572657:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313387008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788813321.572695:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788813321.572741:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313387008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813321.572748:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788813321.572786:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313387008:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788813321.572865:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788813321.636584:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813322.599320:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813322.599343:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313387136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813322.599407:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813322.599482:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313387136 00000100:00100000:0.0:1788813322.599489:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313387136 00000100:00100000:0.0:1788813322.599549:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788813322.599558:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313387136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813322.599592:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788813322.599637:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313387136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813322.599643:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788813322.599700:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313387136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813322.600558:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813322.600572:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313387264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813322.600629:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813322.600776:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313387264 00000100:00100000:2.0:1788813322.600783:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313387264 00000100:00100000:2.0:1788813322.600825:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788813322.600833:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313387264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788813322.600860:0:17902:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788813322.600921:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313387264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813322.600927:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788813322.601089:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313387264:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788813322.661083:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788813323.114020:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:3.0:1788813323.114036:0:17142:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1788813323.114209:0:17202:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1788813323.114220:0:17202:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:0.0:1788813323.203553:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813323.203655:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813323.203790:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813323.203913:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301793280 00000100:00100000:3.0:1788813323.203923:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301793280 00000100:00100000:3.0:1788813323.204186:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301793408 00000100:00100000:3.0:1788813323.204190:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301793408 00000100:00100000:3.0:1788813323.204228:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4 00000100:00100000:3.0:1788813323.204238:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+14:2399:x1875706301793280:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813323.204253:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813323.204270:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cda200/0xf32533d6ff70400d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a8d expref: 14 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813323.204287:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813323.204332:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:2399:x1875706301793280:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 96us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813323.204339:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4 00000100:00100000:3.0:1788813323.204354:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:3.0:1788813323.204360:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+12:2396:x1875706301793408:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813323.204367:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813323.204374:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc08600/0xf32533d6ff704014 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729abe expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813323.204383:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813323.204397:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:2396:x1875706301793408:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 38us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813323.204403:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:0.0:1788813323.205305:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813323.205377:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301793792 00000100:00100000:1.0:1788813323.205383:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301793792 00000100:00100000:1.0:1788813323.205435:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 33 00000100:00100000:1.0:1788813323.205455:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2395:x1875706301793792:12345-192.168.202.13@tcp:9:umount.0 00000020:00000080:1.0:1788813323.205505:0:18670:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff704030 00000020:00010000:1.0:1788813323.205514:0:18670:0:(genops.c:1920:obd_stale_export_put()) Put export ffff948942c68000: total 0 00000100:00080000:1.0:1788813323.205518:0:18670:0:(import.c:65:import_set_state_nolock()) ffff948942c6d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788813323.205562:0:18670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1788813323.205731:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+4:2395:x1875706301793792:12345-192.168.202.13@tcp:9:umount.0 Request processed in 277us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813323.205738:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 33 00000100:00100000:3.0:1788813323.206373:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301793536 00000100:00100000:3.0:1788813323.206380:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301793536 00000100:00100000:3.0:1788813323.206413:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00100000:3.0:1788813323.206420:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:2399:x1875706301793536:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813323.206430:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813323.206460:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff704099 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b74 expref: 11 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813323.206483:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813323.206513:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+10:2399:x1875706301793536:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 94us (2723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813323.206518:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00080000:0.0:1788813323.206906:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:0.0:1788813323.206927:0:17151:0:(genops.c:1906:obd_stale_export_get()) Get export ffff948942c68000: total 0 00010000:00010000:0.0:1788813323.206982:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813323.207053:0:17151:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff948942c68000, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1788813323.207096:0:17151:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788813323.207117:0:17151:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788813310 -> 1788813311 00002000:00010000:0.0:1788813323.207121:0:17151:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788813310 -> 1788813311 00002000:00010000:0.0:1788813323.207134:0:17151:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788813323.207746:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003035cccc/0xf32533d6ff70439b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c54 expref: 3 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813323.207839:0:17151:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff948942c68000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788813323.207857:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813323.207858:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813323.207860:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813323.218341:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813323.220170:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301794688 00000100:00100000:2.0:1788813323.220187:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301794688 00000100:00100000:2.0:1788813323.220286:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 76 00000100:00100000:2.0:1788813323.220300:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+12:2395:x1875706301794688:12345-192.168.202.13@tcp:39:umount.0 00000020:00000080:2.0:1788813323.220336:0:17164:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff704022 00000020:00010000:2.0:1788813323.220352:0:17164:0:(genops.c:1920:obd_stale_export_put()) Put export ffff948a44e16800: total 0 00000100:00080000:2.0:1788813323.220358:0:17164:0:(import.c:65:import_set_state_nolock()) ffff948a7b57c000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788813323.220370:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1788813323.220382:0:19586:0:(genops.c:1906:obd_stale_export_get()) Get export ffff948a44e16800: total 0 00000001:00000004:2.0:1788813323.220383:0:17164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00010000:00010000:0.0:1788813323.220457:0:19586:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff948a44e16800, canceled 0 locks, left on hash table 7. 00010000:00010000:0.0:1788813323.220494:0:19586:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6aed9800) 00010000:00010000:0.0:1788813323.220498:0:19586:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813323.220507:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff704109 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b82 expref: 11 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813323.220530:0:19586:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948a6aed9e00) 00010000:00010000:0.0:1788813323.220533:0:19586:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788813323.220536:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70434e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c31 expref: 10 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813323.220550:0:19586:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe50d00) 00010000:00010000:0.0:1788813323.220553:0:19586:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813323.220556:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff704148 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b90 expref: 9 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813323.220559:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+9:2395:x1875706301794688:12345-192.168.202.13@tcp:39:umount.0 Request processed in 263us (2227us total) trans 8589934637 rc 0/0 00000100:00100000:2.0:1788813323.220567:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 76 00010000:00010000:0.0:1788813323.220570:0:19586:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff948a455eed00) 00010000:00010000:0.0:1788813323.220572:0:19586:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813323.220591:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9e00/0xf32533d6ff7040ed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b7b expref: 7 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813323.220608:0:19586:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948a6fe50e00) 00010000:00010000:0.0:1788813323.220610:0:19586:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788813323.220614:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff7041cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bba expref: 6 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813323.220678:0:19586:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:0.0:1788813323.220681:0:19586:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813323.220685:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c1c expref: 5 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813323.220698:0:19586:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:0.0:1788813323.220700:0:19586:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788813323.220704:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7043b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c5b expref: 4 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813323.220718:0:19586:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff948a44e16800, canceled 7 locks, left on hash table 0. 00010000:00010000:0.0:1788813323.220733:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813323.220735:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813323.220736:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813323.234146:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813323.234272:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301794816 00000100:00100000:0.0:1788813323.234290:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301794816 00000100:00100000:0.0:1788813323.234377:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 77 00000100:00100000:0.0:1788813323.234387:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2395:x1875706301794816:12345-192.168.202.13@tcp:39:umount.0 00000020:00000080:0.0:1788813323.234432:0:17161:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff704029 00000100:00080000:0.0:1788813323.234460:0:17161:0:(import.c:65:import_set_state_nolock()) ffff948a6e6de800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788813323.234501:0:17161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1788813323.234679:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813323.234754:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+3:2395:x1875706301794816:12345-192.168.202.13@tcp:39:umount.0 Request processed in 367us (618us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788813323.234762:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 77 00000100:00080000:1.0:1788813323.234877:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788813323.684155:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813324.160509:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813324.160555:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813324.160592:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813324.160674:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301795200 00000100:00100000:0.0:1788813324.160686:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301795200 00000100:00100000:0.0:1788813324.160758:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301795072 00000100:00100000:0.0:1788813324.160761:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301795072 00000100:00100000:0.0:1788813324.160785:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 82 00000100:00100000:0.0:1788813324.160795:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342c3357-8551-4188-a7af-8af88d224192+5:2399:x1875706301795200:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813324.160864:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342c3357-8551-4188-a7af-8af88d224192+5:2399:x1875706301795200:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 70us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813324.160871:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 82 00000100:00100000:0.0:1788813324.160889:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 83 00000100:00100000:0.0:1788813324.160895:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342c3357-8551-4188-a7af-8af88d224192+6:2399:x1875706301795072:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813324.160920:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342c3357-8551-4188-a7af-8af88d224192+6:2399:x1875706301795072:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 25us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813324.160925:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 83 00000100:00080000:1.0:1788813324.161113:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813324.161118:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788813324.161176:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301794944 00000100:00100000:3.0:1788813324.161180:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301794944 00000100:00100000:3.0:1788813324.161215:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 171 00000100:00100000:3.0:1788813324.161221:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+10:2399:x1875706301794944:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813324.161260:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+10:2399:x1875706301794944:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 39us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813324.161265:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 171 00000100:00100000:3.0:1788813324.644813:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313387392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813324.644898:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813324.645226:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813324.645565:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313388032:0@lo:400:kworker.0 00000100:00100000:0.0:1788813324.645604:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813324.645625:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313388544:0@lo:400:kworker.0 00000100:00100000:0.0:1788813324.645644:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813324.645663:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788813324.645669:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313387904:0@lo:400:kworker.0 00000100:00100000:0.0:1788813324.645693:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813324.645733:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313388416:0@lo:400:kworker.0 00000100:00100000:0.0:1788813324.645756:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813324.645773:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313388928:0@lo:400:kworker.0 00000100:00100000:0.0:1788813324.645793:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813324.645823:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313387904 00000100:00100000:0.0:1788813324.645830:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313387904 00000100:00100000:0.0:1788813324.645885:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788813324.645894:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313387904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813324.645978:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313387904:12345-0@lo:400:kworker.0 Request processed in 85us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813324.645985:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788813324.646013:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313387648:0@lo:400:kworker.0 00000100:00100000:3.0:1788813324.646180:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313387520:0@lo:400:kworker.0 00000100:00100000:3.0:1788813324.646215:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813324.646527:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313387392 00000100:00100000:2.0:1788813324.646540:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313387392 00000100:00100000:2.0:1788813324.646576:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788813324.646583:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313387392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813324.646605:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788813324.646644:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313387392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813324.646650:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788813324.646686:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313387520 00000100:00100000:2.0:1788813324.646689:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313387520 00000100:00100000:2.0:1788813324.646713:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788813324.646719:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+24:3627:x1875706313387520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813324.646746:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+24:3627:x1875706313387520:12345-0@lo:400:kworker.0 Request processed in 28us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813324.646753:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788813324.646792:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313388032 00000100:00100000:2.0:1788813324.646796:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313388032 00000100:00100000:2.0:1788813324.646816:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313388544 00000100:00100000:2.0:1788813324.646818:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313388544 00000100:00100000:2.0:1788813324.646833:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313388416 00000100:00100000:2.0:1788813324.646835:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313388416 00000100:00100000:2.0:1788813324.646844:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313388928 00000100:00100000:2.0:1788813324.646846:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313388928 00000100:00100000:2.0:1788813324.646859:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788813324.646864:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313388032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813324.646891:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313388032:12345-0@lo:400:kworker.0 Request processed in 27us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813324.646896:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788813324.646907:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788813324.646918:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313388544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813324.646970:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313388544:12345-0@lo:400:kworker.0 Request processed in 52us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813324.646976:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788813324.646990:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788813324.646994:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313388416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813324.647017:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313388416:12345-0@lo:400:kworker.0 Request processed in 23us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813324.647021:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788813324.647032:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788813324.647180:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313387520:0@lo:400:kworker.0 00000100:00100000:3.0:1788813324.647199:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313387392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813324.647218:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813324.647224:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313389056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813324.647262:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813324.647291:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313389056 00000100:00100000:3.0:1788813324.647294:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313389056 00000100:00100000:3.0:1788813324.647321:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788813324.647326:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313389056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813324.647341:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788813324.647371:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313389056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813324.647692:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788813324.647735:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313389056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813324.648024:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313388928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813324.648170:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813324.648204:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313388160:0@lo:400:kworker.0 00000100:00100000:2.0:1788813324.648334:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313388928:12345-0@lo:400:kworker.0 Request processed in 1296us (2539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813324.648342:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788813324.649355:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813324.649584:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313387904:0@lo:400:kworker.0 00000100:00100000:2.0:1788813324.649599:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313388416:0@lo:400:kworker.0 00010000:00080000:2.0:1788813324.649613:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccf9500 x1875706313388928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813324.649623:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313388928:0@lo:400:kworker.0 00000100:00100000:2.0:1788813324.649634:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313388032:0@lo:400:kworker.0 00000100:00100000:2.0:1788813324.649645:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313388544:0@lo:400:kworker.0 00000100:00100000:2.0:1788813324.649692:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313387648 00000100:00100000:2.0:1788813324.649699:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313387648 00000100:00100000:2.0:1788813324.649758:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313388160 00000100:00100000:2.0:1788813324.649761:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313388160 00000100:00100000:2.0:1788813324.649777:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788813324.649784:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313387648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813324.649844:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313387648:12345-0@lo:400:kworker.0 Request processed in 60us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813324.649851:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788813324.649866:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788813324.649872:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313388160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813324.649898:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313388160:12345-0@lo:400:kworker.0 Request processed in 27us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813324.649903:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788813324.650322:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313387776:0@lo:400:kworker.0 00000100:00100000:1.0:1788813324.650362:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813324.650400:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313388288:0@lo:400:kworker.0 00000100:00100000:1.0:1788813324.650421:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813324.650455:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313388800:0@lo:400:kworker.0 00000100:00100000:1.0:1788813324.650476:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813324.650500:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813324.650506:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313389184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813324.650522:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313388160:0@lo:400:kworker.0 00000100:00100000:1.0:1788813324.650531:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813324.650532:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313388672:0@lo:400:kworker.0 00000100:00100000:0.0:1788813324.650566:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813324.650570:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313389184 00000100:00100000:1.0:1788813324.650575:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313389184 00000100:00100000:0.0:1788813324.650607:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313387648:0@lo:400:kworker.0 00000100:00100000:1.0:1788813324.650613:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813324.650622:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313389184:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788813324.650647:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788813324.650650:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1788813324.650655:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788813324.650660:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813324.650663:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813324.650675:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313388800 00000100:00100000:0.0:1788813324.650680:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313388800 00000100:00100000:1.0:1788813324.650707:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313389184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813324.650714:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788813324.650720:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313388672 00000100:00100000:0.0:1788813324.650730:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313388672 00000100:00100000:1.0:1788813324.650753:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313389184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813324.650766:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788813324.650776:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313388800:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788813324.650783:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788813324.650788:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813324.650821:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313388800:12345-0@lo:400:kworker.0 Request processed in 46us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813324.650828:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788813324.650842:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313388800:0@lo:400:kworker.0 00000100:00100000:0.0:1788813324.650845:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788813324.650857:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313388672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813324.650892:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313388672:12345-0@lo:400:kworker.0 Request processed in 37us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813324.650900:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1788813324.650910:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a71412a00 x1875706313388672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813324.650921:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313388672:0@lo:400:kworker.0 00000100:00100000:2.0:1788813324.651639:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313387776 00000100:00100000:2.0:1788813324.651646:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313387776 00000100:00100000:2.0:1788813324.651681:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313388288 00000100:00100000:2.0:1788813324.651684:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313388288 00000100:00100000:2.0:1788813324.651722:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788813324.651729:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313387776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813324.651779:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313387776:12345-0@lo:400:kworker.0 Request processed in 50us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813324.651785:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788813324.651799:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788813324.651804:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313388288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813324.651831:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313388288:12345-0@lo:400:kworker.0 Request processed in 27us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813324.651836:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788813324.652150:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813324.652178:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313387776:0@lo:400:kworker.0 00000100:00100000:1.0:1788813324.652189:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313388288:0@lo:400:kworker.0 00010000:00010000:0.0:1788813324.709750:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788813325.159840:0:18665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 39adb0c8-c140-4b12-b8dc-f0861ff799f7 00000020:00000080:1.0:1788813325.159851:0:18665:0:(genops.c:885:class_export_put()) final put ffff948942c68000/39adb0c8-c140-4b12-b8dc-f0861ff799f7 00000001:00100000:1.0:1788813325.159879:0:18665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 342c3357-8551-4188-a7af-8af88d224192 00000020:00000080:1.0:1788813325.159882:0:18665:0:(genops.c:885:class_export_put()) final put ffff948a6e6dc000/342c3357-8551-4188-a7af-8af88d224192 00000020:00000080:0.0:1788813325.160959:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c68000/39adb0c8-c140-4b12-b8dc-f0861ff799f7 for lustre-OST0000 00000020:00000080:0.0:1788813325.161019:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6e6dc000/342c3357-8551-4188-a7af-8af88d224192 for lustre-OST0000 00000020:00000080:0.0:1788813325.161039:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948942c6d000 for lustre-OST0000 00000020:00000080:0.0:1788813325.161045:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6e6df000 for lustre-OST0000 00000001:00100000:2.0:1788813325.161863:0:19483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 342c3357-8551-4188-a7af-8af88d224192 00000020:00000080:2.0:1788813325.161885:0:19483:0:(genops.c:885:class_export_put()) final put ffff948a6e6d9800/342c3357-8551-4188-a7af-8af88d224192 00000001:00100000:2.0:1788813325.161910:0:19483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 39adb0c8-c140-4b12-b8dc-f0861ff799f7 00000020:00000080:2.0:1788813325.161913:0:19483:0:(genops.c:885:class_export_put()) final put ffff948a7b57f800/39adb0c8-c140-4b12-b8dc-f0861ff799f7 00000020:00000080:1.0:1788813325.161999:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6e6d9800/342c3357-8551-4188-a7af-8af88d224192 for lustre-OST0001 00000020:00000080:1.0:1788813325.162046:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b57f800/39adb0c8-c140-4b12-b8dc-f0861ff799f7 for lustre-OST0001 00000020:00000080:1.0:1788813325.162062:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6e6dd000 for lustre-OST0001 00000020:00000080:1.0:1788813325.162066:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a7b56a800 for lustre-OST0001 00000040:00080000:0.0:1788813325.348253:0:17196:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788813325.348262:0:17196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813325.348282:0:17196:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788813325.348291:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788813325.378349:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813325.378550:0:20304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301795328 00000100:00100000:1.0:1788813325.378561:0:20304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301795328 00000100:00100000:1.0:1788813325.378701:0:20304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:1.0:1788813325.378712:0:20304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+10:2397:x1875706301795328:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813325.378731:0:20304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813325.378752:0:20304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc09400/0xf32533d6ff70404c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729afd expref: 10 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813325.378770:0:20304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813325.378834:0:20304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+9:2397:x1875706301795328:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 124us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813325.378842:0:20304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:3.0:1788813325.382301:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813325.382355:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813325.382516:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301795584 00000100:00100000:1.0:1788813325.382529:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301795584 00000100:00100000:1.0:1788813325.382600:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301795456 00000100:00100000:1.0:1788813325.382603:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301795456 00000100:00100000:1.0:1788813325.383181:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:1.0:1788813325.383195:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+10:2398:x1875706301795584:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813325.383211:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813325.383231:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff704092 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b6d expref: 10 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813325.383250:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813325.383318:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+9:2398:x1875706301795584:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 128us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813325.383326:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:1.0:1788813325.383345:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:1.0:1788813325.383354:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+8:2396:x1875706301795456:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813325.383362:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813325.383386:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cdae00/0xf32533d6ff704053 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b2e expref: 8 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813325.383395:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813325.383429:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+7:2396:x1875706301795456:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 65us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813325.383436:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:2.0:1788813325.389927:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813325.391638:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301795840 00000100:00100000:0.0:1788813325.391653:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301795840 00000100:00100000:0.0:1788813325.391723:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 78 00000100:00100000:0.0:1788813325.391734:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342c3357-8551-4188-a7af-8af88d224192+6:2395:x1875706301795840:12345-192.168.202.13@tcp:39:umount.0 00000020:00000080:0.0:1788813325.391776:0:18693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff704061 00000020:00010000:0.0:1788813325.391784:0:18693:0:(genops.c:1920:obd_stale_export_put()) Put export ffff948a443b3800: total 0 00000100:00080000:0.0:1788813325.391789:0:18693:0:(import.c:65:import_set_state_nolock()) ffff948a443b4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788813325.391837:0:18693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:0.0:1788813325.392018:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342c3357-8551-4188-a7af-8af88d224192+5:2395:x1875706301795840:12345-192.168.202.13@tcp:39:umount.0 Request processed in 285us (2100us total) trans 8589934638 rc 0/0 00000100:00100000:0.0:1788813325.392026:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 78 00000020:00010000:1.0:1788813325.392142:0:17150:0:(genops.c:1906:obd_stale_export_get()) Get export ffff948a443b3800: total 0 00010000:00010000:1.0:1788813325.392197:0:17150:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff948a443b3800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788813325.392234:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe50d00) 00010000:00010000:1.0:1788813325.392238:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813325.392245:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff704156 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b97 expref: 4 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813325.392279:0:17150:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff948a443b3800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788813325.392291:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813325.392293:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813325.392295:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813325.413029:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813325.413113:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301795968 00000100:00100000:3.0:1788813325.413125:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301795968 00000100:00100000:3.0:1788813325.413253:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 79 00000100:00100000:3.0:1788813325.413274:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342c3357-8551-4188-a7af-8af88d224192+5:2395:x1875706301795968:12345-192.168.202.13@tcp:39:umount.0 00000020:00000080:3.0:1788813325.413318:0:17164:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff704068 00000100:00080000:3.0:1788813325.413329:0:17164:0:(import.c:65:import_set_state_nolock()) ffff948a443b6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788813325.413364:0:17164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788813325.413555:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342c3357-8551-4188-a7af-8af88d224192+3:2395:x1875706301795968:12345-192.168.202.13@tcp:39:umount.0 Request processed in 283us (535us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788813325.413564:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 79 00010000:00010000:1.0:1788813325.414268:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813325.466378:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813325.466507:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301796224 00000100:00100000:0.0:1788813325.466518:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301796224 00000100:00100000:0.0:1788813325.466582:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 173 00000100:00100000:0.0:1788813325.466592:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+7:2395:x1875706301796224:12345-192.168.202.13@tcp:251:umount.0 00000020:00000080:0.0:1788813325.466764:0:17154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703fff 00000020:00010000:0.0:1788813325.466774:0:17154:0:(genops.c:1920:obd_stale_export_put()) Put export ffff948a6ae41800: total 0 00000100:00080000:0.0:1788813325.466779:0:17154:0:(import.c:65:import_set_state_nolock()) ffff948a44e12800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788813325.466972:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+3:2395:x1875706301796224:12345-192.168.202.13@tcp:251:umount.0 Request processed in 380us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813325.466981:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 173 00000020:00010000:1.0:1788813325.475073:0:19586:0:(genops.c:1906:obd_stale_export_get()) Get export ffff948a6ae41800: total 0 00010000:00010000:1.0:1788813325.475086:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813325.475161:0:19586:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff948a6ae41800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788813325.475206:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8400/0xf32533d6ff704006 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a86 expref: 2 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813325.475227:0:19586:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff948a6ae41800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788813325.475238:0:19586:0:(genops.c:885:class_export_put()) final put ffff948a6ae41800/8d3a369b-b89e-4ca2-be4d-9afac76fe88b 00010000:00010000:1.0:1788813325.475261:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813325.475263:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813325.475279:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788813325.475403:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6ae41800/8d3a369b-b89e-4ca2-be4d-9afac76fe88b for MGS 00000020:00000080:0.0:1788813325.475459:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a44e12800 for MGS 00010000:00010000:1.0:1788813325.732443:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813326.695009:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313389312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813326.695091:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813326.695353:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313389312 00000100:00100000:3.0:1788813326.695361:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313389312 00000100:00080000:0.0:1788813326.695539:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813326.695599:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788813326.695612:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313389312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788813326.695660:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788813326.695720:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313389312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813326.695877:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788813326.695957:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313389312:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788813326.763628:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788813327.528061:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1788813327.614704:0:20734:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788813327.633083:0:20734:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788813327.633140:0:20734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703bc9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.633155:0:20734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703bc9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.633163:0:20734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703bc9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.633171:0:20734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703bc9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.633193:0:20734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788813327.633198:0:20734:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788813327.633222:0:20734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788813327.633227:0:20734:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788813327.633232:0:20734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788813327.633258:0:20734:0:(import.c:65:import_set_state_nolock()) ffff948a6e8eb000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788813327.633460:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313389440:0@lo:39:umount.0 00000100:00100000:2.0:1788813327.633536:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813327.633646:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313389440 00000100:00100000:3.0:1788813327.633654:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313389440 00000100:00100000:3.0:1788813327.633706:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788813327.633715:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875706313389440:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788813327.633743:0:18693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703bf3 00000100:00080000:3.0:1788813327.633752:0:18693:0:(import.c:65:import_set_state_nolock()) ffff948a50e3c800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788813327.633826:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3624:x1875706313389440:12345-0@lo:39:umount.0 Request processed in 112us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813327.633833:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:3.0:1788813327.633843:0:18693:0:(genops.c:885:class_export_put()) final put ffff948a50e3e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788813327.633868:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a50e3e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788813327.633910:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a50e3c800 for lustre-MDT0000 00000100:00080000:2.0:1788813327.634013:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a6e8eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788813327.634031:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313389440:0@lo:39:umount.0 00000100:00080000:3.0:1788813327.634081:0:20734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788813327.634085:0:20734:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788813327.634088:0:20734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788813327.634576:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813327.634586:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703bc9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813327.634597:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40031600 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813327.634601:0:19586:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703bc9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813327.634611:0:19586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff703bc9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813327.634619:0:19586:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff703bc9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813327.634627:0:19586:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788813327.634630:0:19586:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788813327.634633:0:19586:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788813327.634666:0:19586:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703bc9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813327.634673:0:19586:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788813327.634732:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313389568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813327.634790:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813327.635045:0:20734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703b1a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635058:0:20734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703b1a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635065:0:20734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703b1a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635072:0:20734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703b1a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635093:0:20734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813327.635099:0:20734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703e62 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635105:0:20734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703e62 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635112:0:20734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703e62 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635128:0:20734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703e62 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635138:0:20734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788813327.635143:0:20734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040d1 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635150:0:20734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7040d1 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635158:0:20734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff7040d1 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635163:0:20734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff7040d1 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635172:0:20734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788813327.635177:0:20734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703b0c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635183:0:20734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703b0c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635190:0:20734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703b0c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635196:0:20734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703b0c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.635215:0:20734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788813327.635219:0:20734:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788813327.635248:0:20734:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788813327.635252:0:20734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788813327.635255:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813327.635260:0:20734:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1788813327.635265:0:20734:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9489436e9000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788813327.635271:0:20734:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff948a6ae44000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788813327.635275:0:20734:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff948a7b57c800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788813327.635280:0:20734:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff948a7b56e800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788813327.635288:0:20734:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff948a443b3800 342c3357-8551-4188-a7af-8af88d224192 192.168.202.13@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1788813327.635293:0:20734:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff948a44e16800 39adb0c8-c140-4b12-b8dc-f0861ff799f7 192.168.202.13@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:3.0:1788813327.635297:0:20734:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9489420799c0) has exports, disconnecting them 00000020:00080000:3.0:1788813327.635301:0:20734:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9489436e9000), last request at 1788813324 00000020:00000080:3.0:1788813327.635307:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703e2a 00000100:00080000:3.0:1788813327.635323:0:20734:0:(import.c:65:import_set_state_nolock()) ffff9489436ed800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788813327.635364:0:20734:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9489436e9000): rc 0 00000020:00000080:3.0:1788813327.635366:0:20734:0:(genops.c:885:class_export_put()) final put ffff9489436e9000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788813327.635377:0:20734:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff948a6ae44000), last request at 1788813324 00000020:00000080:3.0:1788813327.635380:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703d90 00000100:00080000:3.0:1788813327.635386:0:20734:0:(import.c:65:import_set_state_nolock()) ffff948a6ae40800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788813327.635392:0:20734:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a6ae44000): rc 0 00000020:00000080:3.0:1788813327.635408:0:20734:0:(genops.c:885:class_export_put()) final put ffff948a6ae44000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788813327.635413:0:20734:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff948a7b57c800), last request at 1788813255 00000020:00000080:3.0:1788813327.635415:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703ce1 00000100:00080000:3.0:1788813327.635426:0:20734:0:(import.c:65:import_set_state_nolock()) ffff948a7b57a800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788813327.635435:0:20734:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a7b57c800): rc 0 00000020:00000080:3.0:1788813327.635437:0:20734:0:(genops.c:885:class_export_put()) final put ffff948a7b57c800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788813327.635441:0:20734:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff948a7b56e800), last request at 1788813255 00000020:00000080:3.0:1788813327.635445:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703c86 00000100:00080000:3.0:1788813327.635448:0:20734:0:(import.c:65:import_set_state_nolock()) ffff948943446800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788813327.635454:0:20734:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00080000:3.0:1788813327.635525:0:20734:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a7b56e800): rc 0 00000004:00000080:3.0:1788813327.635532:0:20734:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb2650831fae0 00000100:00080000:3.0:1788813327.635550:0:20734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788813327.635553:0:20734:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788813327.636339:0:20734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788813327.636363:0:20734:0:(import.c:65:import_set_state_nolock()) ffff948a44ca1000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788813327.636515:0:20734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788813327.636519:0:20734:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1788813327.636530:0:20734:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788813327.636584:0:20734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788813327.636595:0:20734:0:(import.c:65:import_set_state_nolock()) ffff948a611ab800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788813327.636601:0:20734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788813327.636603:0:20734:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1788813327.636613:0:20734:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788813327.636663:0:20734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788813327.636671:0:20734:0:(import.c:65:import_set_state_nolock()) ffff948a507c3800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788813327.636710:0:20734:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9489420799c0) has no exports 00000020:00000080:3.0:1788813327.636747:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9489436e9000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788813327.636787:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6ae44000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788813327.636807:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b57c800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788813327.636825:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9489436ed800 for lustre-MDT0000 00000020:00000080:3.0:1788813327.636842:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6ae40800 for lustre-MDT0000 00000020:00000080:3.0:1788813327.636845:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a7b57a800 for lustre-MDT0000 00000100:00100000:3.0:1788813327.636865:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313389568 00000100:00100000:3.0:1788813327.636873:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313389568 00000100:00100000:3.0:1788813327.636923:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788813327.636959:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a777d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7e65740-fccd-471b-95df-6f83776cc95f+24:3627:x1875706313389568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813327.636974:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813327.636979:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703bc9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813327.636993:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703bc9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.636994:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948943657200/0xf32533d6ff703bc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff703bc2 expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.637017:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813327.637018:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788813327.637030:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703b1a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813327.637038:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40031400 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813327.637043:0:19586:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703b1a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813327.637053:0:19586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff703b1a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813327.637061:0:19586:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff703b1a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813327.637069:0:19586:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788813327.637071:0:19586:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1788813327.637075:0:19586:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1788813327.637327:0:19586:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703b1a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813327.637334:0:19586:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788813327.641627:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313390080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813327.641710:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813327.643853:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788813327.643865:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703e62 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.643874:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda400 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813327.643879:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703e62 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.643888:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff703e62 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813327.643903:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff703e62 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813327.643908:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788813327.643911:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788813327.643915:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788813327.643976:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703e62 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.643982:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813327.644023:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703e62 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.644029:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703e62 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.644041:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813327.644045:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff7040d1 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.644049:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8000 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813327.644051:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff7040d1 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.644057:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff7040d1 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813327.644063:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff7040d1 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813327.644079:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788813327.644081:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788813327.644083:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788813327.644097:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff7040d1 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.644103:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813327.644109:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff7040d1 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.644115:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff7040d1 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.644123:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813327.644126:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703b0c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.644132:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40031000 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813327.644135:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703b0c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.644142:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff703b0c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813327.644148:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff703b0c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813327.644153:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788813327.644154:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788813327.644156:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788813327.644176:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703b0c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.644183:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813327.644199:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703b0c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.644207:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703b0c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.644216:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813327.644218:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813327.644219:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813327.644226:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813327.644332:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313390208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813327.644392:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813327.644442:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813327.644449:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313390336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813327.644474:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a777d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7e65740-fccd-471b-95df-6f83776cc95f+23:3627:x1875706313389568:12345-0@lo:103:ldlm_bl.0 Request processed in 7539us (9679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.644477:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813327.644491:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788813327.644531:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313390080 00000100:00100000:0.0:1788813327.644539:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313390080 00000100:00100000:3.0:1788813327.644559:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313390208 00000100:00100000:3.0:1788813327.644565:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313390208 00000100:00100000:0.0:1788813327.644575:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313390336 00000100:00100000:0.0:1788813327.644580:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313390336 00000100:00100000:3.0:1788813327.644595:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813327.644605:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943126300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7e65740-fccd-471b-95df-6f83776cc95f+25:3628:x1875706313390080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813327.644616:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813327.644632:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc09a00/0xf32533d6ff703b1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff703b13 expref: 25 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.644645:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813327.644677:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943126300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7e65740-fccd-471b-95df-6f83776cc95f+24:3628:x1875706313390080:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (2967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.647497:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813327.647520:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+24:3625:x1875706313390208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813327.647543:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813327.647566:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff703e62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff703e5b expref: 24 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.647585:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813327.647676:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+23:3625:x1875706313390208:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (3284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.647684:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813327.647705:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813327.647712:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+22:3625:x1875706313390336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813327.647720:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813327.647730:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cdac00/0xf32533d6ff7040d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff7040ca expref: 22 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.647739:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813327.647762:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+21:3625:x1875706313390336:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (3287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.647769:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813327.648124:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313390336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813327.648136:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313390208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813327.648436:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703b1a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813327.648445:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703b1a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813327.648463:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813327.648465:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813327.648468:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813327.650740:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813327.650998:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313390080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813327.651020:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813327.651044:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313390464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813327.651100:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813327.651151:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313390464 00000100:00100000:3.0:1788813327.651158:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313390464 00000100:00100000:3.0:1788813327.651204:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813327.651212:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+20:3628:x1875706313390464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813327.651226:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813327.651245:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a43dac400/0xf32533d6ff703b0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff703b05 expref: 20 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.651260:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813327.651291:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+19:3628:x1875706313390464:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813327.651298:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813327.651324:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313390464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813327.654109:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313389568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813327.656740:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313389696:0@lo:39:umount.0 00000100:00100000:0.0:1788813327.656903:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813327.657017:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313389824:0@lo:9:umount.0 00000100:00100000:0.0:1788813327.657045:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813327.657136:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313389696 00000100:00100000:2.0:1788813327.657144:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313389696 00000100:00100000:2.0:1788813327.657199:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788813327.657208:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875706313389696:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788813327.657240:0:17902:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703d0b 00000100:00080000:2.0:1788813327.657250:0:17902:0:(import.c:65:import_set_state_nolock()) ffff948a6aec6800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788813327.657362:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313389952:0@lo:9:umount.0 00000100:00100000:0.0:1788813327.657388:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:2.0:1788813327.657428:0:17902:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788813327.657552:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3624:x1875706313389696:12345-0@lo:39:umount.0 Request processed in 345us (649us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788813327.657559:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:2.0:1788813327.657587:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813327.670370:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313389824 00000100:00100000:1.0:1788813327.670414:0:18671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313389824 00000100:00100000:1.0:1788813327.670490:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313389952 00000100:00100000:1.0:1788813327.670493:0:18671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313389952 00000100:00100000:1.0:1788813327.670521:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813327.670533:0:18671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875706313389824:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788813327.670566:0:18671:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703e69 00000100:00080000:1.0:1788813327.670577:0:18671:0:(import.c:65:import_set_state_nolock()) ffff9489436e9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788813327.670622:0:18671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1788813327.670793:0:18671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3624:x1875706313389824:12345-0@lo:9:umount.0 Request processed in 264us (13747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813327.670801:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813327.670816:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788813327.670823:0:18671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875706313389952:12345-0@lo:9:umount.0 00010000:00010000:0.0:1788813327.671394:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788813327.671537:0:18671:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703e70 00000100:00080000:1.0:1788813327.671546:0:18671:0:(import.c:65:import_set_state_nolock()) ffff9489436ea000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788813327.671585:0:18671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788813327.671693:0:18671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3624:x1875706313389952:12345-0@lo:9:umount.0 Request processed in 871us (14302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813327.671700:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1788813327.671782:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788813327.672246:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813327.672252:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813327.672643:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a507c3800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788813327.672665:0:3624:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788813327.672667:0:3624:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788813327.672688:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313389952:0@lo:9:umount.0 00000100:00080000:0.0:1788813327.672729:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a44ca1000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788813327.672735:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313389696:0@lo:39:umount.0 00000100:00080000:0.0:1788813327.672749:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a611ab800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788813327.672780:0:3624:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788813327.672782:0:3624:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788813327.672785:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313389824:0@lo:9:umount.0 00000020:00080000:2.0:1788813327.692463:0:20734:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9489420799c0) has no exports 00000100:00100000:1.0:1788813327.716187:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313390592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813327.716259:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813327.716365:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313390592 00000100:00100000:3.0:1788813327.716374:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313390592 00000100:00100000:3.0:1788813327.716433:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788813327.716442:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3628:x1875706313390592:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788813327.716450:0:17168:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788813327.716505:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3628:x1875706313390592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (245us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788813327.716512:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:02020000:1.0:1788813327.716638:0:3628:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788813327.730589:0:3628:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788813327.730596:0:3628:0:(import.c:65:import_set_state_nolock()) ffff948a6e9e8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788813327.730601:0:3628:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788813327.764583:0:3628:0:(import.c:65:import_set_state_nolock()) ffff948a6e9e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813327.764614:0:3628:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 408 00000100:00080000:1.0:1788813327.764629:0:3628:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff948a6e9e8000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813327.764874:0:3628:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a7ccbdf80 x1875706313390720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788813327.765056:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313390720:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788813327.765154:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813327.765253:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313390720 00000100:00100000:3.0:1788813327.765262:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313390720 00000100:00100000:3.0:1788813327.765308:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788813327.765324:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1875706313390720:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788813327.765343:0:17167:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788813327.768480:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1875706313390720:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 3146us (3316us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813327.768498:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788813327.768574:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a6e9e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788813327.768581:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788813327.768585:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313390720:0@lo:38:ptlrpcd_00_03.0 00000020:00000080:2.0:1788813327.783281:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703b60 00000020:00000080:2.0:1788813327.783300:0:20734:0:(genops.c:885:class_export_put()) final put ffff948a611ad000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788813327.783321:0:20734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788813327.783428:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a611ad000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788813327.783460:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1788813327.783469:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788813327.783470:0:20734:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788813327.783477:0:20734:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff948942dc8000) has no exports 00000020:00000080:3.0:1788813327.785029:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703b59 00000020:00000080:3.0:1788813327.785040:0:20734:0:(genops.c:885:class_export_put()) final put ffff948942c7c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788813327.785110:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813327.785120:0:20734:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788813327.785123:0:20734:0:(genops.c:885:class_export_put()) final put ffff948a60187800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788813327.785126:0:20734:0:(genops.c:844:class_export_destroy()) destroying export ffff948a60187800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788813327.785133:0:20734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788813327.785286:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c7c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:3.0:1788813328.742523:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788813328.742534:0:17142:0:(genops.c:885:class_export_put()) final put ffff948a7b56e800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788813328.742558:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 342c3357-8551-4188-a7af-8af88d224192 00000001:00080000:3.0:1788813328.742566:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:3.0:1788813328.742570:0:17142:0:(genops.c:885:class_export_put()) final put ffff948a443b3800/342c3357-8551-4188-a7af-8af88d224192 00000001:00100000:3.0:1788813328.742575:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 39adb0c8-c140-4b12-b8dc-f0861ff799f7 00000001:00080000:3.0:1788813328.742580:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:3.0:1788813328.742582:0:17142:0:(genops.c:885:class_export_put()) final put ffff948a44e16800/39adb0c8-c140-4b12-b8dc-f0861ff799f7 00000020:00000080:0.0:1788813328.742833:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b56e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788813328.742892:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a443b3800/342c3357-8551-4188-a7af-8af88d224192 for lustre-MDT0000 00000020:00000080:0.0:1788813328.742923:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a44e16800/39adb0c8-c140-4b12-b8dc-f0861ff799f7 for lustre-MDT0000 00000020:00000080:0.0:1788813328.742973:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948943446800 for lustre-MDT0000 00000020:00000080:0.0:1788813328.742978:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a443b4800 for lustre-MDT0000 00000020:00000080:0.0:1788813328.742982:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a7b57c000 for lustre-MDT0000 00000001:00100000:0.0:1788813328.743813:0:17895:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788813328.743826:0:17895:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1788813328.743830:0:17895:0:(genops.c:885:class_export_put()) final put ffff948a6aec2800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788813328.743846:0:17895:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 342c3357-8551-4188-a7af-8af88d224192 00000001:00080000:0.0:1788813328.743851:0:17895:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1788813328.743853:0:17895:0:(genops.c:885:class_export_put()) final put ffff948a443b2800/342c3357-8551-4188-a7af-8af88d224192 00000001:00100000:0.0:1788813328.743859:0:17895:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 39adb0c8-c140-4b12-b8dc-f0861ff799f7 00000001:00080000:0.0:1788813328.743864:0:17895:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1788813328.743866:0:17895:0:(genops.c:885:class_export_put()) final put ffff948a6e6dd800/39adb0c8-c140-4b12-b8dc-f0861ff799f7 00000020:00000080:3.0:1788813328.743914:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6aec2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788813328.743995:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a443b2800/342c3357-8551-4188-a7af-8af88d224192 for lustre-MDT0001 00000020:00000080:3.0:1788813328.744026:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6e6dd800/39adb0c8-c140-4b12-b8dc-f0861ff799f7 for lustre-MDT0001 00000020:00000080:3.0:1788813328.744380:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6aec6800 for lustre-MDT0001 00000020:00000080:3.0:1788813328.744410:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a443b6000 for lustre-MDT0001 00000020:00000080:3.0:1788813328.744413:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6e6de800 for lustre-MDT0001 00010000:00010000:0.0:1788813328.806957:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788813329.766974:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788813329.766981:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788813329.766984:0:37:0:(import.c:65:import_set_state_nolock()) ffff948a6e9e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813329.766994:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 480 00000100:00080000:3.0:1788813329.767000:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788813329.767011:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff948a6e9e8000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813329.767035:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489436e6300 x1875706313390976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788813329.767250:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313391104:0@lo:400:kworker.0 00000100:00100000:3.0:1788813329.767318:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813329.767356:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313391616:0@lo:400:kworker.0 00000100:00100000:3.0:1788813329.767387:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813329.767413:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788813329.767419:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313390848:0@lo:400:kworker.0 00000100:00100000:3.0:1788813329.767446:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813329.767469:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313391488:0@lo:400:kworker.0 00000100:00100000:3.0:1788813329.767489:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813329.767521:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313391360:0@lo:400:kworker.0 00000100:00100000:3.0:1788813329.767541:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813329.767558:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313391872:0@lo:400:kworker.0 00000100:00100000:3.0:1788813329.767576:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813329.767801:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313390976:0@lo:38:kworker.0 00000100:00100000:1.0:1788813329.767837:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813329.767876:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313390976 00000100:00100000:1.0:1788813329.767887:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313390976 00000100:00100000:1.0:1788813329.767927:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788813329.767953:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3624:x1875706313390976:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788813329.767968:0:17902:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788813329.769151:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313392000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813329.769210:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.769283:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313392000 00000100:00100000:0.0:1788813329.769290:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313392000 00000100:00100000:0.0:1788813329.769348:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788813329.769358:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313392000:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813329.769361:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788813329.769373:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313391232:0@lo:400:kworker.0 00002000:00000024:0.0:1788813329.769403:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788813329.769435:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813329.769473:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313391744:0@lo:400:kworker.0 00000100:00100000:3.0:1788813329.769498:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813329.769521:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313391104 00000100:00100000:3.0:1788813329.769526:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313391104 00000100:00100000:2.0:1788813329.770265:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313391616 00000100:00100000:2.0:1788813329.770274:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313391616 00000100:00100000:2.0:1788813329.770313:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313391488 00000100:00100000:2.0:1788813329.770317:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313391488 00000100:00100000:2.0:1788813329.770329:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313391360 00000100:00100000:2.0:1788813329.770331:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313391360 00000100:00100000:2.0:1788813329.770341:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313391872 00000100:00100000:2.0:1788813329.770343:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313391872 00000100:00100000:2.0:1788813329.770359:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313391744 00000100:00100000:2.0:1788813329.770362:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313391744 00000100:00100000:2.0:1788813329.770387:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788813329.770396:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313391616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813329.770451:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313391616:12345-0@lo:400:kworker.0 Request processed in 57us (3062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813329.770458:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788813329.770480:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788813329.770487:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313391872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813329.770525:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313391872:12345-0@lo:400:kworker.0 Request processed in 39us (2947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813329.770531:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788813329.770546:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788813329.770549:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3626:x1875706313391488:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788813329.770555:0:17163:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788813329.770581:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3626:x1875706313391488:12345-0@lo:400:kworker.0 Request processed in 30us (3090us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788813329.770599:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788813329.770615:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788813329.770619:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3628:x1875706313391360:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788813329.770624:0:17163:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788813329.770647:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3628:x1875706313391360:12345-0@lo:400:kworker.0 Request processed in 27us (3105us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788813329.770652:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788813329.770665:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788813329.770668:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3628:x1875706313391744:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788813329.770673:0:17163:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788813329.770693:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3628:x1875706313391744:12345-0@lo:400:kworker.0 Request processed in 23us (1195us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788813329.770698:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788813329.770741:0:3628:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788813329.770746:0:3628:0:(import.c:65:import_set_state_nolock()) ffff948a7cceb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788813329.770750:0:3628:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788813329.772208:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313392000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2845us (2990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813329.772220:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788813329.780181:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313391232 00000100:00100000:0.0:1788813329.780199:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313391232 00000100:00100000:0.0:1788813329.780273:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788813329.780285:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313391104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813329.780396:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313391104:12345-0@lo:400:kworker.0 Request processed in 113us (13076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813329.780402:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788813329.780421:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788813329.780428:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313391232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813329.780458:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313391232:12345-0@lo:400:kworker.0 Request processed in 31us (11024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813329.780464:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788813329.780549:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313392000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813329.780639:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313390848 00000100:00100000:0.0:1788813329.780644:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313390848 00000100:00100000:0.0:1788813329.780671:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788813329.780678:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+19:3626:x1875706313390848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813329.780726:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+19:3626:x1875706313390848:12345-0@lo:400:kworker.0 Request processed in 49us (13279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813329.780733:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:0.0:1788813329.780780:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788813329.780786:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813329.780789:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813329.780819:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313390848:0@lo:400:kworker.0 00000100:00080000:0.0:1788813329.780834:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788813329.780840:0:3626:0:(import.c:65:import_set_state_nolock()) ffff948a4a56a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788813329.780843:0:3626:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788813329.780848:0:3626:0:(import.c:65:import_set_state_nolock()) ffff948a4a56a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813329.780852:0:3626:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 422 00000100:00080000:0.0:1788813329.780861:0:3626:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff948a4a56a000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813329.780891:0:3626:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a7ccbdf80 x1875706313392128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813329.780912:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313391488:0@lo:400:kworker.0 00000100:00100000:0.0:1788813329.780927:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313391104:0@lo:400:kworker.0 00010000:00080000:0.0:1788813329.782090:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489443b1880 x1875706313391616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813329.782105:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313391616:0@lo:400:kworker.0 00000100:00100000:0.0:1788813329.782179:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313392128:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788813329.782234:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.782426:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313392128 00000100:00100000:0.0:1788813329.782433:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313392128 00000100:00100000:0.0:1788813329.782469:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788813329.782476:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3624:x1875706313392128:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788813329.782491:0:17163:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788813329.782530:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3624:x1875706313392128:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 52us (295us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788813329.782537:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788813329.782570:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a4a56a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788813329.782575:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788813329.782578:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313392128:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1788813329.792038:0:3628:0:(import.c:65:import_set_state_nolock()) ffff948a7cceb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813329.792048:0:3628:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 439 00000100:00080000:2.0:1788813329.792064:0:3628:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff948a7cceb000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813329.792110:0:3628:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948943125f80 x1875706313392256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813329.792138:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313391744:0@lo:400:kworker.0 00000100:00080000:2.0:1788813329.792171:0:3628:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788813329.792176:0:3628:0:(import.c:65:import_set_state_nolock()) ffff94894372e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788813329.792193:0:3628:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788813329.792196:0:3628:0:(import.c:65:import_set_state_nolock()) ffff94894372e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813329.792199:0:3628:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 408 00000100:00080000:2.0:1788813329.792205:0:3628:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94894372e000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813329.792232:0:3628:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948943125c00 x1875706313392384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813329.792242:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313391360:0@lo:400:kworker.0 00010000:00080000:2.0:1788813329.792260:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489443b2680 x1875706313391872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813329.792270:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313391872:0@lo:400:kworker.0 00000100:00100000:2.0:1788813329.792304:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313391232:0@lo:400:kworker.0 00000100:00100000:0.0:1788813329.793585:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313392256:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788813329.793662:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.793694:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875706313392384:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788813329.793712:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813329.793859:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313392256 00000100:00100000:3.0:1788813329.793867:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313392256 00000100:00100000:3.0:1788813329.793902:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313392384 00000100:00100000:3.0:1788813329.793904:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313392384 00000100:00100000:3.0:1788813329.793922:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788813329.793928:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313392256:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788813329.793961:0:17164:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788813329.794005:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313392256:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 76us (342us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813329.794012:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788813329.794027:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788813329.794031:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313392384:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788813329.794037:0:17164:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788813329.794055:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313392384:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 23us (343us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813329.794060:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788813329.794089:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7cceb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813329.794093:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813329.794097:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313392256:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788813329.794104:0:3624:0:(import.c:65:import_set_state_nolock()) ffff94894372e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813329.794107:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813329.794109:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875706313392384:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788813329.812682:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3624:x1875706313390976:12345-0@lo:38:kworker.0 Request processed in 44717us (44832us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788813329.812699:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788813329.812731:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a6e9e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813329.812741:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813329.812745:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313390976:0@lo:38:kworker.0 00000020:01000000:3.0:1788813329.828079:0:20734:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9489430f3600 - data ffff948a71837000/ffff948a6e68ec00 00010000:00010000:0.0:1788813329.828206:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788813329.828282:0:20734:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948a45a12720 - data ffff948a71859bd0/ffff948a77aed400 00000001:00000004:2.0:1788813329.838561:0:20734:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:0.0:1788813329.896407:0:20734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788813329.896418:0:20734:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788813329.896434:0:20734:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9489436e5c00 x1875706313389696/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788813337 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813329.896464:0:20734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788813329.900717:0:20734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788813329.900726:0:20734:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1788813329.900752:0:20734:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788813329.900755:0:20734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788813329.901740:0:17186:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788813329.901747:0:17186:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:1.0:1788813329.901758:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788813329.905372:0:20734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788813329.905389:0:20734:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1788813329.905422:0:20734:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788813329.905425:0:20734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788813329.905829:0:17188:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788813329.905835:0:17188:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1788813329.905845:0:17188:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788813329.907082:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703b28 00000020:00000080:0.0:1788813329.907096:0:20734:0:(genops.c:885:class_export_put()) final put ffff9489440e3000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788813329.908218:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9489440e3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788813329.909476:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703b3d 00000020:00000080:0.0:1788813329.909488:0:20734:0:(genops.c:885:class_export_put()) final put ffff948a7142d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788813329.909508:0:20734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788813329.909514:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813329.909522:0:20734:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788813329.909527:0:20734:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff948942078000) has no exports 00000004:01000000:0.0:1788813329.909908:0:20734:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788813329.909920:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703b9f 00000020:00000080:0.0:1788813329.909926:0:20734:0:(genops.c:885:class_export_put()) final put ffff948a507c1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788813329.909956:0:20734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788813329.909961:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813329.909965:0:20734:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788813329.909969:0:20734:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff948a7b703380) has no exports 00000020:00000080:0.0:1788813329.909976:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703b98 00000020:00000080:0.0:1788813329.909979:0:20734:0:(genops.c:885:class_export_put()) final put ffff948a507c0000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788813329.910340:0:20734:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788813329.910345:0:20734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788813329.910349:0:20734:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1788813329.910356:0:20734:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788813329.910358:0:20734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788813329.910397:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788813329.910404:0:20734:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788813329.910409:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703b8a 00000020:00000080:0.0:1788813329.910413:0:20734:0:(genops.c:885:class_export_put()) final put ffff948a7142b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788813329.910417:0:20734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788813329.910420:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813329.910423:0:20734:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788813329.910424:0:20734:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff948a779399c0) has no exports 00000020:00000080:0.0:1788813329.910439:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703b83 00000020:00000080:0.0:1788813329.910453:0:20734:0:(genops.c:885:class_export_put()) final put ffff948a611ab000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788813329.910773:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7142d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788813329.910782:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a507c1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788813329.910786:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a507c0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788813329.910791:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a507c3800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788813329.910798:0:37:0:(genops.c:885:class_export_put()) final put ffff948a7142f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788813329.910800:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7142f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788813329.910804:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788813329.910881:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7142b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788813329.910886:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a611ab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788813329.911615:0:20734:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788813329.911620:0:20734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788813329.911624:0:20734:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1788813329.911629:0:20734:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788813329.911646:0:20734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788813329.911733:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788813329.911741:0:20734:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788813329.911755:0:20734:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788813329.911761:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703b75 00000020:00000080:0.0:1788813329.911768:0:20734:0:(genops.c:885:class_export_put()) final put ffff948a71428800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788813329.916752:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a611ab800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788813329.916773:0:37:0:(genops.c:885:class_export_put()) final put ffff948a7142a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788813329.916776:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7142a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788813329.916784:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788813329.923788:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a71428800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788813329.924264:0:20734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788813329.924294:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813329.924304:0:20734:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788813329.924309:0:20734:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff948a7653cd40) has no exports 00000020:00000080:0.0:1788813329.924318:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703b6e 00000020:00000080:0.0:1788813329.924327:0:20734:0:(genops.c:885:class_export_put()) final put ffff948a44ca3800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788813329.924743:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a44ca3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788813329.925524:0:20734:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788813329.925529:0:20734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788813329.925534:0:20734:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788813329.925540:0:20734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788813329.925909:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813329.925961:0:20734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788813329.926013:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813329.926018:0:20734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788813329.926024:0:20734:0:(genops.c:885:class_export_put()) final put ffff9489440e1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788813329.926028:0:20734:0:(genops.c:844:class_export_destroy()) destroying export ffff9489440e1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788813329.926037:0:20734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788813329.926151:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703b44 00000020:00000080:1.0:1788813329.926158:0:20734:0:(genops.c:885:class_export_put()) final put ffff948a7142b800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788813329.926923:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a44ca1000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788813329.926947:0:37:0:(genops.c:885:class_export_put()) final put ffff948a611a8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788813329.926950:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a611a8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788813329.926956:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788813329.927200:0:20734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788813329.927206:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813329.927213:0:20734:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788813329.927217:0:20734:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff94894207b380) has no exports 00000020:00000080:1.0:1788813329.927241:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813329.927245:0:20734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788813329.927252:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703b4b 00000020:00000080:1.0:1788813329.927256:0:20734:0:(genops.c:885:class_export_put()) final put ffff948a7142e800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788813329.927264:0:20734:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9489437db000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788813329.927267:0:20734:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9489437db000 3 00000020:01000004:1.0:1788813329.927269:0:20734:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9489437db000 from lustre-MDT0000 00000020:00000080:1.0:1788813329.927287:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813329.927291:0:20734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788813329.927293:0:20734:0:(genops.c:885:class_export_put()) final put ffff9489440e2000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788813329.927294:0:20734:0:(genops.c:844:class_export_destroy()) destroying export ffff9489440e2000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788813329.927302:0:20734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788813329.927341:0:20734:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788813329.927345:0:20734:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788813329.927348:0:20734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788813329.927350:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813329.927352:0:20734:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788813329.927359:0:20734:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff948a6eae3000 b7e65740-fccd-471b-95df-6f83776cc95f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788813329.927364:0:20734:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff948942dcb380) has exports, disconnecting them 00000020:00080000:1.0:1788813329.927369:0:20734:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff948a6eae3000), last request at 1788813242 00000020:00000080:1.0:1788813329.927405:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703af0 00000020:00010000:1.0:1788813329.927409:0:20734:0:(genops.c:1920:obd_stale_export_put()) Put export ffff948a6eae3000: total 2 00000100:00080000:1.0:1788813329.927414:0:20734:0:(import.c:65:import_set_state_nolock()) ffff948a6eae5000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788813329.927427:0:20734:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a6eae3000): rc 0 00000020:00080000:1.0:1788813329.927431:0:20734:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff948942dcb380) has no exports 00000020:00000080:3.0:1788813329.927531:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7142b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788813329.927542:0:37:0:(genops.c:885:class_export_put()) final put ffff9489440e0800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788813329.927543:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9489440e0800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788813329.927549:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788813329.927583:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7142e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788813329.928118:0:17156:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff948a6e8f2400:17156] 1 exiting: rc = 0 00000100:00100000:1.0:1788813329.928844:0:17154:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9489423b2400:17154] 0 exiting: rc = 1 00000020:00010000:1.0:1788813329.928908:0:17151:0:(genops.c:1906:obd_stale_export_get()) Get export ffff948a6eae3000: total 0 00010000:00010000:1.0:1788813329.928970:0:17151:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff948a6eae3000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788813329.929003:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a40031c00/0xf32533d6ff703c0f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff703c08 expref: 14 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.929025:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948943656c00/0xf32533d6ff7040a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff7040a0 expref: 13 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.929036:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948943656400/0xf32533d6ff703ccc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff703cc5 expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.929045:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a40031a00/0xf32533d6ff703c1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff703c16 expref: 11 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.929055:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948943657800/0xf32533d6ff7040b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff7040ae expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.929064:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a43dad600/0xf32533d6ff703c2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff703c24 expref: 9 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.929075:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc09c00/0xf32533d6ff703afe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff703af7 expref: 8 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.929084:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a43dac600/0xf32533d6ff703deb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff703de4 expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.929106:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cdb600/0xf32533d6ff703d7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff703d74 expref: 6 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.929117:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cda600/0xf32533d6ff703e15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff703e0e expref: 5 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.929125:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7040c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff7040bc expref: 4 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.929137:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cdba00/0xf32533d6ff703e54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff703e4d expref: 3 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.929147:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a43dad200/0xf32533d6ff703d51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff703d4a expref: 2 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.929157:0:17151:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff948a6eae3000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788813329.929172:0:17151:0:(genops.c:885:class_export_put()) final put ffff948a6eae3000/b7e65740-fccd-471b-95df-6f83776cc95f 00010000:00010000:1.0:1788813329.929181:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813329.929184:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813329.929185:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788813329.929498:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6eae3000/b7e65740-fccd-471b-95df-6f83776cc95f for MGS 00000020:00000080:3.0:1788813329.929531:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6eae5000 for MGS 00000100:00100000:0.0:1788813329.959131:0:17157:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff948a6fa63c00:17157] 2 exiting: rc = 0 00000100:00100000:1.0:1788813329.959316:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959325:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959331:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959338:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959344:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959350:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959356:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959362:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959368:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959383:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959402:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959407:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959413:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959419:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959424:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959429:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959434:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959439:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959443:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959449:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959454:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959460:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959466:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959471:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959476:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959481:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959487:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959492:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959498:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959503:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959510:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959518:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959523:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959528:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959534:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959539:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959545:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959560:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959566:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959571:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959576:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959582:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959587:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959593:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959599:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959612:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959618:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959624:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959629:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959634:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959639:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959645:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959650:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959655:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959660:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959665:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959670:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959676:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959681:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959685:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959691:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959697:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959702:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813329.959708:0:20734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788813329.962624:0:20734:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9489430f34e0 - data ffff948a71a9a510/ffff948a6e68e800 00000020:01000000:1.0:1788813329.962755:0:20734:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948a641fa540 - data ffff948a719bcaf8/ffff948a76798c00 00000020:00000080:1.0:1788813329.963348:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703ad4 00000020:00000080:1.0:1788813329.963357:0:20734:0:(genops.c:885:class_export_put()) final put ffff9489437da000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788813329.963390:0:20734:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9489437db000 from MGS, refs=2 00000020:01000004:1.0:1788813329.963393:0:20734:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9489437db000 2 00000020:01000004:1.0:1788813329.963396:0:20734:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9489437db000 from MGS 00000020:00000080:1.0:1788813329.963416:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813329.963423:0:20734:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788813329.963426:0:20734:0:(genops.c:885:class_export_put()) final put ffff9489437da800/MGS 00000020:00000080:1.0:1788813329.963429:0:20734:0:(genops.c:844:class_export_destroy()) destroying export ffff9489437da800/MGS for MGS 00000020:01000000:1.0:1788813329.963436:0:20734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788813329.963506:0:20734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788813329.963510:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813329.963515:0:20734:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788813329.963531:0:20734:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff948a6e8ec000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788813329.963538:0:20734:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff948a7793b380) has exports, disconnecting them 00000020:00080000:1.0:1788813329.963542:0:20734:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff948a6e8ec000), last request at 1788813243 00000020:00000080:0.0:1788813329.963624:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9489437da000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788813329.963660:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703bd7 00000020:00080000:1.0:1788813329.963671:0:20734:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a6e8ec000): rc 0 00000020:00000080:1.0:1788813329.963676:0:20734:0:(genops.c:885:class_export_put()) final put ffff948a6e8ec000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788813329.963999:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6e8ec000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788813329.964978:0:20734:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788813329.964984:0:20734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788813329.964989:0:20734:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788813329.964995:0:20734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788813329.965156:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788813329.965163:0:20734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788813329.965169:0:20734:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9489437db000 1 00000020:00000080:0.0:1788813329.965174:0:20734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703ac6 00000020:00000080:0.0:1788813329.965181:0:20734:0:(genops.c:885:class_export_put()) final put ffff9489437dc000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788813329.965185:0:20734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788813329.965199:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813329.965202:0:20734:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788813329.965206:0:20734:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff948942dc99c0) has no exports 00000020:00000080:3.0:1788813329.967326:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6e8eb000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788813329.967339:0:36:0:(genops.c:885:class_export_put()) final put ffff948a6e8e8000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788813329.967342:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6e8e8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788813329.967353:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788813329.967439:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9489437dc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788813330.037357:0:20734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788813330.037371:0:20734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788813330.037389:0:20734:0:(genops.c:885:class_export_put()) final put ffff9489437df000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788813330.037394:0:20734:0:(genops.c:844:class_export_destroy()) destroying export ffff9489437df000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788813330.037405:0:20734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788813330.037539:0:20734:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9489437de000 00000020:02000400:0.0:1788813330.039490:0:20734:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788813330.853891:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813331.812318:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813331.812353:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313392512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813331.812467:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813331.812533:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313392512 00000100:00100000:2.0:1788813331.812542:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313392512 00000100:00100000:2.0:1788813331.812608:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788813331.812619:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313392512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788813331.812654:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788813331.812707:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313392512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813331.812715:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788813331.812746:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813331.812794:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313392512:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788813331.879049:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788813332.840232:0:19483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788813332.840243:0:19483:0:(genops.c:885:class_export_put()) final put ffff9489436ef800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788813332.840335:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9489436ef800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788813332.840410:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9489436ea000 for lustre-OST0001 00000001:00100000:0.0:1788813332.841085:0:18665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788813332.841090:0:18665:0:(genops.c:885:class_export_put()) final put ffff9489436ed000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788813332.841919:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9489436ed000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788813332.843300:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9489436e9800 for lustre-OST0000 00010000:00010000:3.0:1788813332.901435:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788813333.476498:0:20935:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788813333.487169:0:20935:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788813333.487223:0:20935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703ccc expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.487240:0:20935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703ccc expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.487247:0:20935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703ccc expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.487255:0:20935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703ccc expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.487380:0:20935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788813333.487387:0:20935:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788813333.487413:0:20935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788813333.487418:0:20935:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788813333.487424:0:20935:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788813333.487430:0:20935:0:(import.c:65:import_set_state_nolock()) ffff94894372e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788813333.487435:0:20935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788813333.487436:0:20935:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788813333.487439:0:20935:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788813333.488139:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813333.488148:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703ccc expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813333.488155:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40030c00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813333.488158:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703ccc expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813333.488165:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff703ccc expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813333.488170:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff703ccc expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813333.488173:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788813333.488175:0:17150:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788813333.488177:0:17150:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788813333.488211:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703ccc expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813333.488215:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788813333.488275:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313392640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813333.488364:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813333.488413:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313392640 00000100:00100000:2.0:1788813333.488422:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313392640 00000100:00100000:2.0:1788813333.488467:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788813333.488475:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3627:x1875706313392640:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788813333.488482:0:17148:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788813333 with bad export cookie 17520466923856345840 00010000:00010000:1.0:1788813333.489417:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703ccc expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813333.489458:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703ccc expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813333.489475:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813333.489477:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813333.489479:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813333.489870:0:20935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703c2b expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.489881:0:20935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703c2b expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.489889:0:20935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703c2b expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.489897:0:20935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703c2b expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.489920:0:20935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813333.489927:0:20935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703e54 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813333.490011:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813333.490018:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703c2b expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813333.490026:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657a00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813333.490030:0:19586:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703c2b expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813333.490038:0:19586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff703c2b expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813333.490045:0:19586:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff703c2b expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813333.490061:0:19586:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788813333.490071:0:19586:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1788813333.490099:0:19586:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703c2b expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813333.490106:0:19586:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788813333.490160:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313392768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813333.490218:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813333.490300:0:20935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703e54 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490319:0:20935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703e54 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490325:0:20935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703e54 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490338:0:20935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813333.490359:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813333.490364:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703e54 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490371:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656800 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813333.490374:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703e54 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490381:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff703e54 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813333.490388:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff703e54 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813333.490393:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788813333.490395:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788813333.490398:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788813333.490414:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703e54 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490421:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813333.490450:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703e54 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490463:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703e54 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490478:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813333.490480:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813333.490481:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813333.490494:0:20935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490501:0:20935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7040c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490508:0:20935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff7040c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490514:0:20935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff7040c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490527:0:20935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813333.490532:0:20935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703c1d expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490539:0:20935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703c1d expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490546:0:20935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703c1d expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490552:0:20935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703c1d expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490570:0:20935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788813333.490573:0:20935:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1788813333.490576:0:20935:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:3.0:1788813333.490614:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813333.490618:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff7040c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490625:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9a00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813333.490628:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff7040c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490634:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff7040c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813333.490641:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff7040c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813333.490647:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788813333.490649:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788813333.490651:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788813333.490666:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff7040c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490672:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813333.490679:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff7040c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490686:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff7040c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490705:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813333.490708:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703c1d expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490714:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657600 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813333.490716:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703c1d expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490723:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff703c1d expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813333.490730:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff703c1d expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813333.490735:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788813333.490737:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788813333.490739:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788813333.490767:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703c1d expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.490773:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813333.490808:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703c2b expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813333.490816:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703c2b expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813333.490826:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813333.490828:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813333.490830:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813333.490842:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313393152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813333.490878:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813333.490921:0:20304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313392768 00000100:00100000:0.0:1788813333.490928:0:20304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313392768 00000100:00100000:0.0:1788813333.490975:0:20304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313393152 00000100:00100000:0.0:1788813333.490978:0:20304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313393152 00000100:00100000:0.0:1788813333.490990:0:20304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788813333.490997:0:20304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3628:x1875706313392768:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788813333.491003:0:20304:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788813333 with bad export cookie 17520466923856345840 00010000:00010000:3.0:1788813333.491609:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703c1d expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.491618:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff703c1d expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813333.491633:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813333.491635:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813333.491645:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788813333.491660:0:20935:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788813333.491665:0:20935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788813333.491670:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813333.491675:0:20935:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788813333.491680:0:20935:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9489436e8800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788813333.491687:0:20935:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff948a7cce5800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788813333.491692:0:20935:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff948a76538000) has exports, disconnecting them 00000020:00080000:3.0:1788813333.491696:0:20935:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9489436e8800), last request at 1788813329 00000020:00000080:3.0:1788813333.491702:0:20935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703e3f 00000100:00080000:3.0:1788813333.491719:0:20935:0:(import.c:65:import_set_state_nolock()) ffff9489436ee000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788813333.491761:0:20935:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9489436e8800): rc 0 00000020:00000080:3.0:1788813333.491764:0:20935:0:(genops.c:885:class_export_put()) final put ffff9489436e8800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788813333.491774:0:20935:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff948a7cce5800), last request at 1788813329 00000020:00000080:3.0:1788813333.491777:0:20935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703da5 00000100:00080000:3.0:1788813333.491782:0:20935:0:(import.c:65:import_set_state_nolock()) ffff948a7cce6000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788813333.491792:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788813333.491798:0:20935:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a7cce5800): rc 0 00000020:00000080:3.0:1788813333.491800:0:20935:0:(genops.c:885:class_export_put()) final put ffff948a7cce5800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788813333.491808:0:20935:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb26500d7fae0 00000100:00080000:3.0:1788813333.491828:0:20935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788813333.491836:0:20935:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9489436e5500 x1875706313390592/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788813343 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813333.491847:0:20935:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788813333.493217:0:20935:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788813333.493228:0:20935:0:(import.c:65:import_set_state_nolock()) ffff948a6e9e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:0.0:1788813333.493368:0:20304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3628:x1875706313392768:12345-0@lo:103:ldlm_bl.0 Request processed in 2365us (3146us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788813333.493380:0:20304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788813333.493420:0:20304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788813333.493439:0:20304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a777d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3627:x1875706313393152:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788813333.493447:0:20304:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788813333 with bad export cookie 17520466923856345840 00000100:00100000:0.0:1788813333.493556:0:20304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a777d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3627:x1875706313393152:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (2678us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788813333.493562:0:20304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1788813333.493582:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788813333.493712:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788813333.493717:0:3627:0:(import.c:65:import_set_state_nolock()) ffff948a6eae5800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788813333.493727:0:3627:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.113@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788813333.493770:0:3628:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:0.0:1788813333.498501:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788813333.500863:0:3627:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.113@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788813333.500867:0:3627:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788813333.500876:0:3627:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff948943489c00 x1875706313392640/t0(0) o103->MGC192.168.202.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788813349 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813333.500887:0:3627:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489443b1880 x1875706313392768/t0(0) o103->MGC192.168.202.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788813349 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813333.500894:0:3627:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff948a6eda5f80 x1875706313393152/t0(0) o103->MGC192.168.202.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788813349 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788813333.500906:0:3627:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788813333.500909:0:3627:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788813333.500910:0:3627:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788813333.500915:0:3627:0:(import.c:65:import_set_state_nolock()) ffff948a6eae5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813333.500921:0:3627:0:(import.c:545:import_select_connection()) MGC192.168.202.113@tcp: connect to NID 0@lo last attempt 395 00000100:00080000:3.0:1788813333.500952:0:3627:0:(import.c:666:import_select_connection()) MGC192.168.202.113@tcp: import ffff948a6eae5800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813333.500987:0:3627:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a6eda5c00 x1875706313393280/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813333.500987:0:3628:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff948a6eae5800 already not connected (conn 2, was 1): CONNECTING 00000020:00000080:1.0:1788813333.501009:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9489436e8800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00100000:3.0:1788813333.501019:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b7e65740-fccd-471b-95df-6f83776cc95f:3624:1875706313393280:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1788813333.501141:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875706313393280 offset 0 length 520: 4 00000100:00100000:0.0:1788813333.501146:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:0:1875706313393024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813333.501198:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313392640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813333.501211:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313393152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813333.501228:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:0:1875706313392896:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1788813333.501271:0:17148:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875706313392640 offset 224 length 224: 4 00000100:00080000:3.0:1788813333.501280:0:20935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788813333.501282:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3627:x1875706313392640:12345-0@lo:103:ldlm_bl.0 Request processed in 12807us (12919us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788813333.501284:0:20935:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000100:00100000:2.0:1788813333.501292:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:00000080:1.0:1788813333.501393:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7cce5800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000004:00080000:3.0:1788813333.501414:0:20935:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1788813333.501417:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9489436ee000 for lustre-MDT0001 00000020:00000080:1.0:1788813333.501421:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a7cce6000 for lustre-MDT0001 00000100:00080000:3.0:1788813333.501475:0:20935:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788813333.501490:0:20935:0:(import.c:65:import_set_state_nolock()) ffff948a611ac800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788813333.501525:0:20935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788813333.501528:0:20935:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788813333.501539:0:20935:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788813333.501593:0:20935:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788813333.501596:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313390592:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788813333.501602:0:20935:0:(import.c:65:import_set_state_nolock()) ffff948a7b790000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788813333.501611:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313392768:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788813333.501636:0:20935:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff948a76538000) has no exports 00000100:00100000:2.0:1788813333.501651:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313393408:0@lo:9:umount.0 00000100:00100000:2.0:1788813333.501687:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813333.501717:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313393536:0@lo:9:umount.0 00000100:00100000:3.0:1788813333.501724:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313393408 00000100:00100000:3.0:1788813333.501732:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313393408 00000100:00100000:2.0:1788813333.501738:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788813333.501767:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813333.501775:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313393536 00000100:00100000:3.0:1788813333.501778:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313393536 00000100:00100000:3.0:1788813333.501807:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788813333.501816:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875706313393408:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788813333.501840:0:18670:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703dcf 00000100:00080000:3.0:1788813333.501849:0:18670:0:(import.c:65:import_set_state_nolock()) ffff948a6ae44800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788813333.501885:0:18670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00080000:2.0:1788813333.501898:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813333.502209:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3624:x1875706313393408:12345-0@lo:9:umount.0 Request processed in 394us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813333.502222:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788813333.502237:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788813333.502243:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875706313393536:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788813333.502256:0:18670:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703e77 00000100:00080000:3.0:1788813333.502262:0:18670:0:(import.c:65:import_set_state_nolock()) ffff948a6ae40000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788813333.502399:0:18670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788813333.502475:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3624:x1875706313393536:12345-0@lo:9:umount.0 Request processed in 232us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813333.502482:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1788813333.502656:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813333.502692:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788813333.502719:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a611ac800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788813333.502737:0:3624:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788813333.502739:0:3624:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788813333.502743:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313393408:0@lo:9:umount.0 00000100:00080000:3.0:1788813333.502758:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b790000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788813333.502767:0:3624:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788813333.502768:0:3624:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788813333.502770:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313393536:0@lo:9:umount.0 00000020:00080000:3.0:1788813333.506467:0:20935:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff948a76538000) has no exports 00000020:01000000:2.0:1788813333.539614:0:20935:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9489410e3600 - data ffff948a71812798/ffff948a4415ec00 00000020:01000000:2.0:1788813333.539780:0:20935:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94894359f6c0 - data ffff948a71a9c510/ffff948a77913000 00000001:00000004:2.0:1788813333.548397:0:20935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1788813333.608322:0:20935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788813333.608331:0:20935:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788813333.608338:0:20935:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788813333.620657:0:20935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788813333.620668:0:20935:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788813333.620698:0:20935:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788813333.620701:0:20935:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788813333.621397:0:17903:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788813333.621402:0:17903:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1788813333.621412:0:17903:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788813333.622456:0:20935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788813333.622462:0:20935:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788813333.622481:0:20935:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788813333.622484:0:20935:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788813333.623864:0:17906:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788813333.623870:0:17906:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788813333.623883:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788813333.624822:0:20935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703c39 00000020:00000080:0.0:1788813333.624834:0:20935:0:(genops.c:885:class_export_put()) final put ffff948942c20800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788813333.625459:0:20935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703c4e 00000020:00000080:0.0:1788813333.625466:0:20935:0:(genops.c:885:class_export_put()) final put ffff948942c25000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788813333.625471:0:20935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788813333.625477:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813333.625486:0:20935:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788813333.625490:0:20935:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff948a765399c0) has no exports 00000020:00000080:1.0:1788813333.625726:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c20800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788813333.625739:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c25000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:0.0:1788813333.625843:0:20935:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788813333.625852:0:20935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703ca2 00000020:00000080:0.0:1788813333.625858:0:20935:0:(genops.c:885:class_export_put()) final put ffff948943443800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788813333.625901:0:20935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788813333.625906:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813333.625911:0:20935:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788813333.625926:0:20935:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff948a7b7019c0) has no exports 00000020:00000080:0.0:1788813333.625953:0:20935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703c9b 00000020:00000080:0.0:1788813333.625957:0:20935:0:(genops.c:885:class_export_put()) final put ffff948a7b797000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788813333.629286:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948943443800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788813333.633532:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b797000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788813333.634313:0:20935:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788813333.634319:0:20935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788813333.634324:0:20935:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788813333.634330:0:20935:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788813333.634333:0:20935:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788813333.634393:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788813333.634404:0:20935:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788813333.634414:0:20935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703c8d 00000020:00000080:0.0:1788813333.634425:0:20935:0:(genops.c:885:class_export_put()) final put ffff948a50e38800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788813333.634430:0:20935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788813333.634438:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813333.634443:0:20935:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788813333.634447:0:20935:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff948a7b700000) has no exports 00000020:00000080:0.0:1788813333.634454:0:20935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703c7f 00000020:00000080:0.0:1788813333.634458:0:20935:0:(genops.c:885:class_export_put()) final put ffff948a611ad800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788813333.634758:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a7b790000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788813333.634767:0:36:0:(genops.c:885:class_export_put()) final put ffff948a50e3a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788813333.634769:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a50e3a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788813333.634786:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788813333.634869:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a50e38800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788813333.634874:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a611ad800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788813333.635143:0:20935:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788813333.635147:0:20935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788813333.635149:0:20935:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788813333.635154:0:20935:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788813333.635156:0:20935:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788813333.635190:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788813333.635195:0:20935:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788813333.635210:0:20935:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788813333.635218:0:20935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703c71 00000020:00000080:0.0:1788813333.635224:0:20935:0:(genops.c:885:class_export_put()) final put ffff948942c22800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788813333.635228:0:20935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788813333.635231:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813333.635236:0:20935:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788813333.635238:0:20935:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff948a6adb4d40) has no exports 00000020:00000080:0.0:1788813333.635248:0:20935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703c6a 00000020:00000080:0.0:1788813333.635251:0:20935:0:(genops.c:885:class_export_put()) final put ffff948a6e9ef800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788813333.635823:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a611ac800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788813333.635830:0:36:0:(genops.c:885:class_export_put()) final put ffff948a50e3d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788813333.635833:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a50e3d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788813333.635837:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788813333.635884:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c22800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788813333.635889:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6e9ef800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788813333.643131:0:20935:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1788813333.643141:0:20935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788813333.643145:0:20935:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788813333.643154:0:20935:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788813333.643222:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813333.643234:0:20935:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788813333.643265:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813333.643269:0:20935:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788813333.643275:0:20935:0:(genops.c:885:class_export_put()) final put ffff948a61045000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788813333.643281:0:20935:0:(genops.c:844:class_export_destroy()) destroying export ffff948a61045000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788813333.643288:0:20935:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788813333.643447:0:20935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703c55 00000020:00000080:1.0:1788813333.643454:0:20935:0:(genops.c:885:class_export_put()) final put ffff948942c27000/lustre-MDD0001_UUID 00000020:01000000:1.0:1788813333.643459:0:20935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1788813333.643463:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813333.643468:0:20935:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788813333.643471:0:20935:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff948a7653b380) has no exports 00000020:00000080:1.0:1788813333.643506:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813333.643510:0:20935:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1788813333.643514:0:20935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703c5c 00000020:00000080:1.0:1788813333.643527:0:20935:0:(genops.c:885:class_export_put()) final put ffff948942c21000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1788813333.643536:0:20935:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a7b569800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1788813333.643539:0:20935:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7b569800 2 00000020:01000004:1.0:1788813333.643542:0:20935:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff948a7b569800 from lustre-MDT0001 00000020:00000080:1.0:1788813333.643558:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813333.643562:0:20935:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788813333.643564:0:20935:0:(genops.c:885:class_export_put()) final put ffff948942c26000/lustre-MDT0001_UUID 00000020:00000080:1.0:1788813333.643566:0:20935:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c26000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788813333.643572:0:20935:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1788813333.643599:0:20935:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788813333.643602:0:20935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788813333.643604:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813333.643607:0:20935:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788813333.643631:0:20935:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff948a7b578000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788813333.643637:0:20935:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff948a7b704d40) has exports, disconnecting them 00000020:00080000:1.0:1788813333.643641:0:20935:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff948a7b578000), last request at 1788813255 00000020:00000080:1.0:1788813333.643644:0:20935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703cda 00000020:00080000:1.0:1788813333.643658:0:20935:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a7b578000): rc 0 00000020:00000080:1.0:1788813333.643661:0:20935:0:(genops.c:885:class_export_put()) final put ffff948a7b578000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788813333.644365:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6e9e8000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788813333.644374:0:36:0:(genops.c:885:class_export_put()) final put ffff948942c23000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788813333.644376:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c23000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788813333.644385:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788813333.644497:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c27000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788813333.644501:0:36:0:(genops.c:885:class_export_put()) final put ffff948942c25800/lustre-MDD0001_UUID 00000020:00000080:3.0:1788813333.644503:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c25800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788813333.644508:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788813333.644603:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c21000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788813333.644609:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b578000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788813333.721013:0:20935:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788813333.721027:0:20935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788813333.721031:0:20935:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788813333.721066:0:20935:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788813333.721657:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94894372e000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788813333.722457:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813333.722469:0:20935:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788813333.722475:0:20935:0:(genops.c:885:class_export_put()) final put ffff948a7b790800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788813333.722480:0:20935:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b790800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788813333.722488:0:20935:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788813333.722610:0:20935:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7b569800 1 00000020:00000080:1.0:1788813333.722616:0:20935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703c01 00000020:00000080:1.0:1788813333.722631:0:20935:0:(genops.c:885:class_export_put()) final put ffff94894344c000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788813333.722640:0:20935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788813333.722645:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813333.722650:0:20935:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788813333.722654:0:20935:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff948a7793cd40) has no exports 00000020:00000080:3.0:1788813333.722952:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94894344c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788813333.766096:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813333.766111:0:20935:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788813333.766117:0:20935:0:(genops.c:885:class_export_put()) final put ffff948a7b56c800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788813333.766132:0:20935:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b56c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788813333.766137:0:20935:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788813333.766255:0:20935:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff948a7b56b800 00000020:01000000:3.0:1788813333.766275:0:20935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788813333.766280:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813333.766284:0:20935:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788813333.766289:0:20935:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff94894207cd40) has no exports 00000100:00100000:3.0:1788813333.766391:0:17161:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff94894359ba00:17161] 0 exiting: rc = 1 00000100:00100000:0.0:1788813333.766573:0:17164:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff948943013200:17164] 2 exiting: rc = 0 00000100:00100000:1.0:1788813333.766719:0:18693:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9489410c3600:18693] 3 exiting: rc = 0 00000100:00100000:2.0:1788813333.766860:0:17163:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff94894359b800:17163] 1 exiting: rc = 0 00000100:00100000:3.0:1788813333.767263:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767270:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767276:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767282:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767287:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767292:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767298:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767304:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767310:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767318:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767324:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767331:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767347:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767353:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767359:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767365:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767371:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767378:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767384:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767390:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767397:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767402:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767407:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767412:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767417:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767422:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767443:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767448:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767453:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767459:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767465:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767471:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767476:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767482:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767488:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767493:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767499:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767504:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767510:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767515:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767520:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767526:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767532:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767537:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767542:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767547:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767552:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767557:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767562:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767568:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767573:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767578:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767583:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767588:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767594:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767600:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767606:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767612:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767617:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767623:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767628:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767640:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767646:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.767651:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771121:0:17166:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff948a465d6600:17166] 1 exiting: rc = 0 00000100:00100000:0.0:1788813333.771323:0:17165:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff948a465d7c00:17165] 0 exiting: rc = 1 00000100:00100000:1.0:1788813333.771431:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771439:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771446:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771452:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771457:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771462:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771468:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771473:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771478:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771483:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771489:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771494:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771499:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771503:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771508:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771512:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771518:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771522:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771528:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771538:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771544:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771549:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771554:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771559:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771564:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771570:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771575:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771594:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771599:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771605:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771611:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771616:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771621:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771626:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771632:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771638:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771642:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771648:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771653:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771658:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771663:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771669:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771674:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771680:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771685:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771690:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771695:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771701:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771707:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771713:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771719:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771724:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771729:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771734:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771740:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771746:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771751:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771757:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771762:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771768:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771773:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771779:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771791:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.771797:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772261:0:17902:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff948a4467b200:17902] 2 exiting: rc = 0 00000100:00100000:2.0:1788813333.772398:0:17167:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff948a6ea68e00:17167] 0 exiting: rc = 1 00000100:00100000:0.0:1788813333.772516:0:17168:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff948a42be0a00:17168] 1 exiting: rc = 0 00000100:00100000:1.0:1788813333.772608:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772616:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772623:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772629:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772635:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772641:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772657:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772664:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772670:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772675:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772681:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772686:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772692:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772698:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772704:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772710:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772715:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772722:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772743:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772751:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772757:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772763:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772769:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772775:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772781:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772786:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772793:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772800:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772807:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772813:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772832:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772838:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772850:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772856:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772862:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772868:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772874:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772880:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772886:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772893:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772898:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772905:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.772925:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774032:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774041:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774047:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774054:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774060:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774066:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774071:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774077:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774084:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774090:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774096:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774121:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774129:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774135:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774141:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774147:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774153:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774161:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774167:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774174:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.774180:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813333.783428:0:17169:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff948a42be0000:17169] 0 exiting: rc = 1 00000100:00100000:2.0:1788813333.783533:0:17170:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff948a42be1000:17170] 1 exiting: rc = 0 00000100:00100000:1.0:1788813333.784706:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784712:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784716:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784727:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784731:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784734:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784738:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784742:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784745:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784748:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784751:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784754:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784757:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784760:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784763:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784765:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784768:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784771:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784775:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784778:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784780:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784783:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784786:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784789:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784791:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784794:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784797:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784800:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784803:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784805:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784809:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784812:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784815:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784818:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784822:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784825:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784828:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784831:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784837:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784841:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784844:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784847:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784852:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784857:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784863:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784867:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784872:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784876:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784881:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784886:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784892:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784897:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784901:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784906:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784911:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784916:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784922:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.784927:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785087:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785093:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785098:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785103:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785109:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785115:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813333.785613:0:17171:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff948a6123bc00:17171] 0 exiting: rc = 1 00000100:00100000:0.0:1788813333.785713:0:17172:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff948a42be1a00:17172] 1 exiting: rc = 0 00000100:00100000:1.0:1788813333.785791:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785795:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785799:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785802:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785806:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785809:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785812:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785815:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785819:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785829:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785832:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785836:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785839:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785843:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785846:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785849:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785853:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785858:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785863:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785869:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785873:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785878:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785883:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785888:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785893:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785898:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785902:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785907:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785912:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785917:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785922:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.785926:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787060:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787074:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787080:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787084:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787089:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787094:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787099:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787104:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787108:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787112:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787117:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787122:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787136:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787141:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787145:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787150:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787154:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787160:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787165:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787169:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787173:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787178:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787183:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787189:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787194:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787200:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787205:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787210:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787215:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787220:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787225:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787230:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.787576:0:17174:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff948a469bbe00:17174] 1 exiting: rc = 0 00000100:00100000:2.0:1788813333.787720:0:17173:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff948a469bac00:17173] 0 exiting: rc = 1 00000100:00100000:1.0:1788813333.791658:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791665:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791668:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791672:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791675:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791679:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791681:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791684:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791687:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791690:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791694:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791697:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791700:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791704:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791723:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791727:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791730:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791733:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791736:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791739:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791742:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791747:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791750:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791753:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791757:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791760:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791763:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791766:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791769:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791772:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791776:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791778:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791781:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791784:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791787:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791790:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791793:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791795:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791798:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791801:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791804:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791807:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791810:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791814:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791817:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791820:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791823:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791826:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791829:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791836:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791840:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791843:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791846:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791849:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791854:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791859:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791864:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791869:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791874:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791879:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791883:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791888:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791893:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.791898:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813333.800162:0:17175:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff948a6402f600:17175] 0 exiting: rc = 1 00000100:00100000:3.0:1788813333.800322:0:17176:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff94894206cc00:17176] 1 exiting: rc = 0 00000100:00100000:3.0:1788813333.800576:0:17177:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff94894206c400:17177] 2 exiting: rc = 0 00000100:00100000:1.0:1788813333.800716:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800722:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800726:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800730:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800733:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800737:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800756:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800760:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800764:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800767:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800771:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800775:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800779:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800783:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800788:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800792:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800796:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800800:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800804:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800807:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800822:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800826:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800830:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800833:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800838:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800841:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800844:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800848:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800852:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800856:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800870:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800875:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800878:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800882:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800886:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800890:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800894:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800897:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800901:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800905:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800908:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800912:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800915:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800919:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800922:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.800926:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801164:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801171:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801175:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801179:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801182:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801186:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801189:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801192:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801207:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801215:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801219:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801223:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801227:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801230:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801234:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801238:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801242:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813333.801249:0:20935:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788813333.804765:0:20935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813333.804776:0:20935:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788813333.804781:0:20935:0:(genops.c:885:class_export_put()) final put ffff9489440e4000/MDS_uuid 00000020:00000080:1.0:1788813333.804784:0:20935:0:(genops.c:844:class_export_destroy()) destroying export ffff9489440e4000/MDS_uuid for MDS 00000020:01000000:1.0:1788813333.804788:0:20935:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788813333.804918:0:20935:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788813333.929033:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788813334.885720:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b7e65740-fccd-471b-95df-6f83776cc95f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788813334.885732:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b7e65740-fccd-471b-95df-6f83776cc95f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813334.886536:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788813334.886542:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788813334.886546:0:37:0:(import.c:65:import_set_state_nolock()) ffff948a4a56a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813334.886555:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1788813334.886561:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788813334.886573:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff948a4a56a000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813334.886613:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a6eda6a00 x1875706313393664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813334.887781:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788813334.887785:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788813334.887788:0:37:0:(import.c:65:import_set_state_nolock()) ffff948a7cceb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813334.887794:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1788813334.887798:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1788813334.887805:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313393664:0@lo:38:kworker.0 00000100:00080000:3.0:1788813334.887807:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff948a7cceb000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813334.887830:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a6eda7b80 x1875706313393920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1788813334.887868:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313393664 offset 0 length 520: 4 00000100:00100000:3.0:1788813334.887898:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813334.887913:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313393792:0@lo:400:kworker.0 00000100:00100000:2.0:1788813334.887913:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313393920:0@lo:38:kworker.0 00000400:00000100:3.0:1788813334.887969:0:3627:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313393792 offset 0 length 224: 4 00000400:00000100:2.0:1788813334.887976:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313393920 offset 0 length 520: 4 00000100:00100000:3.0:1788813334.887995:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813334.888006:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313394048:0@lo:400:kworker.0 00000400:00000100:3.0:1788813334.888028:0:3626:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313394048 offset 0 length 224: 4 00010000:00010000:1.0:1788813334.948523:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813335.981527:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813336.997396:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788813337.818088:0:21136:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788813337.849132:0:21136:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788813337.849202:0:21136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d7b expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813337.849216:0:21136:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703d7b expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813337.849225:0:21136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703d7b expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813337.849233:0:21136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703d7b expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813337.849259:0:21136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788813337.849265:0:21136:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788813337.849291:0:21136:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788813337.849314:0:21136:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff948a6eda6a00 x1875706313393664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813349 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813337.849334:0:21136:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788813337.849340:0:21136:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788813337.849346:0:21136:0:(import.c:65:import_set_state_nolock()) ffff948a4a56a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788813337.849350:0:21136:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788813337.849368:0:21136:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff948a6eda6a00 x1875706313393664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813349 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813337.849376:0:21136:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788813337.849379:0:21136:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:1.0:1788813337.849428:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813337.849438:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703d7b expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813337.849446:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656000 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813337.849450:0:19586:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703d7b expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813337.849460:0:19586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff703d7b expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813337.849468:0:19586:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff703d7b expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813337.849475:0:19586:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788813337.849477:0:19586:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788813337.849480:0:19586:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788813337.849499:0:19586:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a6eae5800 00010000:00010000:1.0:1788813337.849504:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff703d7b expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813337.849511:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff703d7b expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813337.849524:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813337.849526:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813337.849528:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813337.849639:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313393664:0@lo:38:kworker.0 00000100:00080000:1.0:1788813337.860846:0:21136:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788813337.860870:0:21136:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff948a6eda5f80 x1875706313393792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813350 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813337.860898:0:21136:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788813337.860905:0:21136:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788813337.860955:0:21136:0:(import.c:65:import_set_state_nolock()) ffff948a4a569000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788813337.861058:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313393792:0@lo:400:kworker.0 00000100:00100000:0.0:1788813337.861219:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1875706313394176:0@lo:39:umount.0 00000400:00000100:0.0:1788813337.861273:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313394176 offset 0 length 224: 4 00010000:00010000:3.0:1788813338.025698:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788813338.916084:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b7e65740-fccd-471b-95df-6f83776cc95f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788813338.916098:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) b7e65740-fccd-471b-95df-6f83776cc95f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813338.916101:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788813338.916105:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788813338.916422:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313394304:0@lo:400:kworker.0 00000400:00000100:0.0:1788813338.916496:0:3626:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313394304 offset 0 length 224: 4 00000001:00100000:2.0:1788813338.985583:0:19483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788813338.985592:0:19483:0:(genops.c:885:class_export_put()) final put ffff948a6ae45000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788813338.987502:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6ae45000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788813338.987584:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6ae40000 for lustre-OST0001 00000001:00100000:1.0:1788813338.989588:0:18665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788813338.989595:0:18665:0:(genops.c:885:class_export_put()) final put ffff948a6ae42800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788813338.989652:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6ae42800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788813338.989870:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6ae44800 for lustre-OST0000 00010000:00010000:3.0:1788813339.044272:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788813339.940223:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b7e65740-fccd-471b-95df-6f83776cc95f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788813339.940233:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b7e65740-fccd-471b-95df-6f83776cc95f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813339.940236:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788813339.940238:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788813339.940384:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813339.940411:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313394432:0@lo:400:kworker.0 00000400:00000100:1.0:1788813339.940466:0:3628:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313394432 offset 0 length 224: 4 00010000:00010000:1.0:1788813340.071014:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813341.092153:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813342.116235:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813343.012320:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813333/real 1788813333] req@ffff948a6eda5c00 x1875706313393280/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788813343 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813343.012354:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948a6eda5c00 x1875706313393280/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788813343 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788813343.012375:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a6eae5800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788813343.012401:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788813343.012427:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b7e65740-fccd-471b-95df-6f83776cc95f:3624:1875706313393280:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1788813343.013364:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b7e65740-fccd-471b-95df-6f83776cc95f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788813343.013373:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788813343.013376:0:37:0:(import.c:65:import_set_state_nolock()) ffff948a6eae5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813343.013382:0:37:0:(import.c:545:import_select_connection()) MGC192.168.202.113@tcp: connect to NID 0@lo last attempt 486 00000100:00080000:1.0:1788813343.013387:0:37:0:(import.c:630:import_select_connection()) MGC192.168.202.113@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788813343.013398:0:37:0:(import.c:666:import_select_connection()) MGC192.168.202.113@tcp: import ffff948a6eae5800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813343.013442:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94894348b480 x1875706313394560/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813343.013473:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788813343.013477:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788813343.013595:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313394688:0@lo:400:kworker.0 00000400:00000100:2.0:1788813343.013647:0:3628:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313394688 offset 0 length 224: 4 00000100:00100000:0.0:1788813343.014319:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b7e65740-fccd-471b-95df-6f83776cc95f:3624:1875706313394560:0@lo:250:kworker.0 00000400:00000100:0.0:1788813343.014345:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875706313394560 offset 0 length 520: 4 00010000:00010000:1.0:1788813343.140952:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813344.170037:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813345.188161:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813346.212180:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813347.108060:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813337/real 1788813337] req@ffff94894348a680 x1875706313394176/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788813347 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813347.108092:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94894348a680 x1875706313394176/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788813347 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788813347.108111:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a4a569000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788813347.108132:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1875706313394176:0@lo:39:umount.0 00000100:00080000:1.0:1788813347.108910:0:21136:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788813347.108915:0:21136:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788813347.108921:0:21136:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788813347.112365:0:21136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d51 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813347.112385:0:21136:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703d51 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813347.112392:0:21136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703d51 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813347.112398:0:21136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703d51 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813347.112475:0:21136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813347.112482:0:21136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040b5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813347.112487:0:21136:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7040b5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813347.112491:0:21136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff7040b5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813347.112508:0:21136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff7040b5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813347.120327:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813347.120346:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703d51 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813347.120360:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657e00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813347.120364:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703d51 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813347.120375:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff703d51 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813347.120409:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff703d51 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813347.120415:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788813347.120419:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1788813347.120435:0:17151:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a6eae5800 00010000:00010000:3.0:1788813347.120439:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff703d51 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813347.120445:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff703d51 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813347.120466:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813347.120470:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff7040b5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813347.120475:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08a00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813347.120478:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff7040b5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813347.120484:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff7040b5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813347.120490:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff7040b5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813347.120495:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788813347.120497:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788813347.120501:0:17151:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a6eae5800 00010000:00010000:3.0:1788813347.120511:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff7040b5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813347.120519:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813347.120521:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813347.120523:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813347.128467:0:21136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788813347.128484:0:21136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff7040b5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813347.128507:0:21136:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788813347.128516:0:21136:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1788813347.128519:0:21136:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788813347.128558:0:21136:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788813347.128562:0:21136:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788813347.128572:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813347.128578:0:21136:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788813347.128582:0:21136:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff948a506e4d40) has no exports 00000020:00080000:1.0:1788813347.128606:0:21136:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff948a506e4d40) has no exports 00010000:00010000:3.0:1788813347.129581:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788813347.130660:0:21136:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94894359f840 - data ffff948a71b1f510/ffff948a44158c00 00000020:01000000:1.0:1788813347.130868:0:21136:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948a44625ae0 - data ffff948a71a011b0/ffff948943079c00 00100000:10000000:1.0:1788813347.137760:0:21136:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788813347.167023:0:21136:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703d5f 00000020:00000080:1.0:1788813347.167039:0:21136:0:(genops.c:885:class_export_put()) final put ffff948a43ed0800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788813347.167053:0:21136:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948943443000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788813347.167057:0:21136:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948943443000 2 00000020:01000004:1.0:1788813347.167061:0:21136:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff948943443000 from lustre-OST0000 00000020:00000080:1.0:1788813347.167086:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813347.167097:0:21136:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788813347.167100:0:21136:0:(genops.c:885:class_export_put()) final put ffff948a43ed7800/lustre-OST0000_UUID 00000020:00000080:1.0:1788813347.167103:0:21136:0:(genops.c:844:class_export_destroy()) destroying export ffff948a43ed7800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788813347.167113:0:21136:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:3.0:1788813347.167295:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a43ed0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1788813347.170211:0:21136:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788813347.170235:0:21136:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788813347.170248:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813347.170258:0:21136:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788813347.170266:0:21136:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff948a7ccae800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788813347.170274:0:21136:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff948a506e19c0) has exports, disconnecting them 00000020:00080000:3.0:1788813347.170280:0:21136:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff948a7ccae800), last request at 1788813269 00000020:00000080:3.0:1788813347.170285:0:21136:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703d89 00000020:00080000:3.0:1788813347.170306:0:21136:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a7ccae800): rc 0 00000020:00000080:3.0:1788813347.170312:0:21136:0:(genops.c:885:class_export_put()) final put ffff948a7ccae800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788813347.170359:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7ccae800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788813347.171920:0:21136:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788813347.171929:0:21136:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788813347.171949:0:21136:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788813347.171956:0:21136:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788813347.172034:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a4a56a000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788813347.172138:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813347.172146:0:21136:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788813347.172151:0:21136:0:(genops.c:885:class_export_put()) final put ffff948a7ccad000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788813347.172155:0:21136:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7ccad000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788813347.172163:0:21136:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788813347.172238:0:21136:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788813347.172242:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813347.172248:0:21136:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788813347.172254:0:21136:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff948943449000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788813347.172259:0:21136:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff948a506e0000) has exports, disconnecting them 00000020:00080000:2.0:1788813347.172264:0:21136:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff948943449000), last request at 1788813269 00000020:00000080:2.0:1788813347.172278:0:21136:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703d9e 00000020:00080000:2.0:1788813347.172292:0:21136:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948943449000): rc 0 00000020:00000080:2.0:1788813347.172297:0:21136:0:(genops.c:885:class_export_put()) final put ffff948943449000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788813347.176431:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948943449000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788813347.208025:0:21136:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788813347.208038:0:21136:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788813347.208043:0:21136:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788813347.208050:0:21136:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788813347.208083:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a4a569000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788813347.208263:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813347.208273:0:21136:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788813347.208280:0:21136:0:(genops.c:885:class_export_put()) final put ffff948a7ccaf800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788813347.208285:0:21136:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7ccaf800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788813347.208298:0:21136:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788813347.208378:0:21136:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948943443000 1 00000020:00000080:1.0:1788813347.208385:0:21136:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703d3c 00000020:00000080:1.0:1788813347.208396:0:21136:0:(genops.c:885:class_export_put()) final put ffff948a6e8ef800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788813347.208412:0:21136:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788813347.208420:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6e8ef800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788813347.208431:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813347.208442:0:21136:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788813347.208445:0:21136:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff948a6adb0000) has no exports 00000020:00000080:1.0:1788813347.261669:0:21136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813347.261682:0:21136:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788813347.261698:0:21136:0:(genops.c:885:class_export_put()) final put ffff948943447800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788813347.261702:0:21136:0:(genops.c:844:class_export_destroy()) destroying export ffff948943447800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788813347.261713:0:21136:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788813347.261830:0:21136:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff948943447000 00000020:02000400:1.0:1788813347.261875:0:21136:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788813347.418228:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788813348.205571:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b7e65740-fccd-471b-95df-6f83776cc95f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788813348.205581:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b7e65740-fccd-471b-95df-6f83776cc95f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813348.205584:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788813348.205586:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788813348.205664:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313394816:0@lo:400:kworker.0 00000400:00000100:3.0:1788813348.205718:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313394816 offset 0 length 224: 4 00010000:00010000:0.0:1788813348.457210:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813349.156032:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813334/real 1788813334] req@ffff948a6eda7b80 x1875706313393920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788813349 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813349.156064:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948a6eda7b80 x1875706313393920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788813349 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788813349.156082:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7cceb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788813349.157430:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788813349.157439:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313393920:0@lo:38:kworker.0 00000100:00080000:3.0:1788813349.157920:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b7e65740-fccd-471b-95df-6f83776cc95f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788813349.157946:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b7e65740-fccd-471b-95df-6f83776cc95f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813349.157948:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788813349.157951:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788813349.157954:0:37:0:(import.c:65:import_set_state_nolock()) ffff948a7cceb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813349.157960:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 487 00000100:00080000:3.0:1788813349.157965:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788813349.157978:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff948a7cceb000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813349.158013:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a6eda4380 x1875706313394944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813349.158075:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313394944:0@lo:38:kworker.0 00000100:00100000:3.0:1788813349.158081:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813349.158092:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313395072:0@lo:400:kworker.0 00000400:00000100:3.0:1788813349.158566:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313395072 offset 0 length 224: 4 00000400:00000100:2.0:1788813349.162265:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313394944 offset 0 length 520: 4 00010000:00010000:3.0:1788813349.477132:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788813350.244555:0:3626:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813334/real 1788813334] req@ffff948a6eda6d80 x1875706313394048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788813350 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813350.271597:0:3626:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff948a6eda6d80 x1875706313394048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788813350 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788813350.271614:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9489436eb000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788813350.271619:0:3626:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788813350.286016:0:3626:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:1.0:1788813350.286393:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313394048:0@lo:400:kworker.0 00000100:00080000:0.0:1788813350.286480:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b7e65740-fccd-471b-95df-6f83776cc95f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788813350.286486:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) b7e65740-fccd-471b-95df-6f83776cc95f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813350.286489:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788813350.286492:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813350.286495:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788813350.286505:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788813350.286509:0:8:0:(import.c:65:import_set_state_nolock()) ffff9489436eb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813350.286514:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 439 00000100:00080000:0.0:1788813350.286527:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9489436eb000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813350.286559:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489443b2a00 x1875706313395200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788813350.286618:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1875706313395200:0@lo:38:kworker.0 00000400:00000100:1.0:1788813350.286667:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313395200 offset 0 length 520: 4 00010000:00010000:1.0:1788813350.501799:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788813351.164869:0:21338:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788813351.177304:0:21338:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788813351.177404:0:21338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703e15 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813351.177419:0:21338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703e15 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813351.177426:0:21338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703e15 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813351.177433:0:21338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703e15 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813351.177451:0:21338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788813351.177455:0:21338:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788813351.177479:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788813351.177490:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff948a6eda4380 x1875706313394944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813351.177502:0:21338:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788813351.177507:0:21338:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788813351.177513:0:21338:0:(import.c:65:import_set_state_nolock()) ffff948a7cceb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788813351.177517:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788813351.177520:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff948a6eda4380 x1875706313394944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813369 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813351.177544:0:21338:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788813351.177548:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:1.0:1788813351.177768:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313394944:0@lo:38:kworker.0 00010000:00010000:0.0:1788813351.177774:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813351.177782:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703e15 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813351.177791:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad000 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813351.177795:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703e15 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813351.177805:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff703e15 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813351.177813:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff703e15 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813351.177832:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788813351.177834:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788813351.177840:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788813351.177853:0:17151:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a6eae5800 00010000:00010000:0.0:1788813351.177858:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff703e15 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813351.177864:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff703e15 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813351.177890:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813351.177893:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813351.177894:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788813351.179560:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788813351.179578:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff948a6eda5f80 x1875706313394304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813354 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813351.179653:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489443b0700 x1875706313394432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813355 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813351.179672:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff948943489f80 x1875706313394688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813359 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813351.179680:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff948a6eda4700 x1875706313394816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813364 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813351.179699:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff948a6eda5180 x1875706313395072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813365 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813351.179707:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489443b2a00 x1875706313395200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813360 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813351.179720:0:21338:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788813351.179726:0:21338:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788813351.179731:0:21338:0:(import.c:65:import_set_state_nolock()) ffff9489436eb000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788813351.179736:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788813351.179740:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff948a6eda5f80 x1875706313394304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813354 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813351.179747:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313395072:0@lo:400:kworker.0 00000100:00100000:3.0:1788813351.179793:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313394688:0@lo:400:kworker.0 00000100:00100000:1.0:1788813351.180081:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313394304:0@lo:400:kworker.0 00000100:00100000:2.0:1788813351.180234:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489443b0700 x1875706313394432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813355 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813351.180242:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff948943489f80 x1875706313394688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813359 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813351.180249:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff948a6eda4700 x1875706313394816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813364 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813351.180269:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff948a6eda5180 x1875706313395072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813365 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813351.180276:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489443b2a00 x1875706313395200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813360 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813351.180282:0:21338:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788813351.183198:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313394816:0@lo:400:kworker.0 00000100:00100000:2.0:1788813351.183264:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:3.0:1788813351.183362:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313394432:0@lo:400:kworker.0 00000100:00100000:1.0:1788813351.183514:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1875706313395200:0@lo:38:kworker.0 00010000:00010000:2.0:1788813351.185035:0:21338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703deb expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813351.185053:0:21338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703deb expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813351.185061:0:21338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703deb expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813351.185067:0:21338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff703deb expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813351.185136:0:21338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813351.185144:0:21338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040a7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813351.185151:0:21338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7040a7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813351.185157:0:21338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff7040a7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813351.185162:0:21338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff7040a7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813351.185385:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813351.185394:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703deb expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813351.185402:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dade00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813351.185406:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff703deb expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813351.185414:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff703deb expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813351.185433:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff703deb expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813351.185440:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788813351.185442:0:17150:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788813351.185454:0:17150:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a6eae5800 00010000:00010000:3.0:1788813351.185458:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff703deb expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813351.185465:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff703deb expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813351.185481:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813351.185484:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff7040a7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813351.185490:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8800 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813351.185493:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff7040a7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813351.185499:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff7040a7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813351.185504:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff7040a7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813351.185508:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788813351.185510:0:17150:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788813351.185514:0:17150:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a6eae5800 00010000:00010000:3.0:1788813351.185523:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff7040a7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813351.185530:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813351.185531:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813351.185533:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813351.185592:0:21338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788813351.185597:0:21338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff7040a7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813351.185610:0:21338:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788813351.185615:0:21338:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788813351.185617:0:21338:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788813351.185644:0:21338:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788813351.185648:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788813351.185653:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813351.185658:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788813351.185663:0:21338:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff948a6adb3380) has no exports 00000020:00080000:2.0:1788813351.185684:0:21338:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff948a6adb3380) has no exports 00010000:00010000:1.0:1788813351.187033:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788813351.190592:0:21338:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9489430f3240 - data ffff948941c30510/ffff948a6e68c800 00000020:01000000:2.0:1788813351.190761:0:21338:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948943268360 - data ffff948a71a7baf8/ffff948942c18000 00100000:10000000:2.0:1788813351.200795:0:21338:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788813351.207717:0:21338:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703df9 00000020:00000080:2.0:1788813351.207728:0:21338:0:(genops.c:885:class_export_put()) final put ffff948a74aa5000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788813351.207775:0:21338:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a7ccad800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788813351.207779:0:21338:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7ccad800 2 00000020:01000004:2.0:1788813351.207782:0:21338:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff948a7ccad800 from lustre-OST0001 00000020:00000080:2.0:1788813351.207808:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813351.207817:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788813351.207820:0:21338:0:(genops.c:885:class_export_put()) final put ffff948a6ae43000/lustre-OST0001_UUID 00000020:00000080:2.0:1788813351.207823:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6ae43000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788813351.207830:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788813351.207914:0:21338:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import b7e65740-fccd-471b-95df-6f83776cc95f->MGS 00010000:00010000:2.0:1788813351.207948:0:21338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948943656600/0xf32533d6ff703c08 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff703c0f expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813351.207972:0:21338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948943656600/0xf32533d6ff703c08 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff703c0f expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813351.207978:0:21338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788813351.207981:0:21338:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788813351.207985:0:21338:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788813351.207997:0:21338:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a6eae5800 00010000:00010000:2.0:1788813351.208001:0:21338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948943656600/0xf32533d6ff703c08 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff703c0f expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813351.208015:0:21338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813351.208022:0:21338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813351.208028:0:21338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788813351.208030:0:21338:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788813351.208031:0:21338:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788813351.208041:0:21338:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a6eae5800 00010000:00010000:2.0:1788813351.208044:0:21338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788813351.208058:0:21338:0:(import.c:65:import_set_state_nolock()) ffff948a6eae5800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788813351.208061:0:21338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788813351.208063:0:21338:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788813351.208065:0:21338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788813351.208068:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788813351.208079:0:21338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94894348b480 x1875706313394560/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788813358 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788813351.208101:0:21338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788813351.208103:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:1.0:1788813351.209594:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a74aa5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788813351.209644:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b7e65740-fccd-471b-95df-6f83776cc95f:3624:1875706313394560:0@lo:250:kworker.0 10000000:01000000:0.0:1788813351.210058:0:21338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788813351.210069:0:21338:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703ae2 00000020:00000080:0.0:1788813351.210077:0:21338:0:(genops.c:885:class_export_put()) final put ffff9489440e7800/b7e65740-fccd-471b-95df-6f83776cc95f 00000020:01000000:0.0:1788813351.210096:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.113@tcp (flags='') 00000020:00000080:0.0:1788813351.210101:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813351.210107:0:21338:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.113@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788813351.210111:0:21338:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff948942dccd40) has no exports 00000020:00000080:2.0:1788813351.210212:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9489440e7800/b7e65740-fccd-471b-95df-6f83776cc95f for MGC192.168.202.113@tcp 10000000:01000000:1.0:1788813351.210264:0:17160:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788813351.210344:0:21338:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.113@tcp: client import never connected 00000100:00080000:0.0:1788813351.210348:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788813351.210351:0:21338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788813351.210353:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788813351.210355:0:21338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788813351.210399:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6eae5800 for MGC192.168.202.113@tcp 00000020:00000080:0.0:1788813351.210399:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788813351.210406:0:21338:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.113@tcp (uuid b7e65740-fccd-471b-95df-6f83776cc95f) 00000020:00000080:0.0:1788813351.210409:0:21338:0:(genops.c:885:class_export_put()) final put ffff948a6eae0000/b7e65740-fccd-471b-95df-6f83776cc95f 00000020:00000080:0.0:1788813351.210411:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6eae0000/b7e65740-fccd-471b-95df-6f83776cc95f for MGC192.168.202.113@tcp 00000020:01000000:0.0:1788813351.210419:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.113@tcp (b7e65740-fccd-471b-95df-6f83776cc95f) 00000020:01000000:0.0:1788813351.210691:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788813351.210695:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813351.210700:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788813351.210705:0:21338:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9489436ec000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788813351.210711:0:21338:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff948a6edb8000) has exports, disconnecting them 00000020:00080000:0.0:1788813351.210724:0:21338:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9489436ec000), last request at 1788813286 00000020:00000080:0.0:1788813351.210728:0:21338:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703e23 00000020:00080000:0.0:1788813351.210739:0:21338:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9489436ec000): rc 0 00000020:00000080:0.0:1788813351.210743:0:21338:0:(genops.c:885:class_export_put()) final put ffff9489436ec000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788813351.210781:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9489436ec000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788813351.212453:0:21338:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788813351.212459:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788813351.212463:0:21338:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788813351.212473:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788813351.212506:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a7cceb000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788813351.212648:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813351.212664:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788813351.212676:0:21338:0:(genops.c:885:class_export_put()) final put ffff948a7cceb800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788813351.212679:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7cceb800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788813351.212685:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788813351.212743:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788813351.212747:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813351.212752:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788813351.212757:0:21338:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9489436eb800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788813351.212763:0:21338:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff948a6edb99c0) has exports, disconnecting them 00000020:00080000:1.0:1788813351.212767:0:21338:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9489436eb800), last request at 1788813286 00000020:00000080:1.0:1788813351.212770:0:21338:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703e38 00000020:00080000:1.0:1788813351.212781:0:21338:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9489436eb800): rc 0 00000020:00000080:1.0:1788813351.212784:0:21338:0:(genops.c:885:class_export_put()) final put ffff9489436eb800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788813351.212819:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9489436eb800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788813351.236004:0:21338:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788813351.236013:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788813351.236017:0:21338:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788813351.236024:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788813351.236088:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1788813351.236284:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9489436eb000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788813351.236968:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788813351.237092:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788813351.237485:0:17146:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff948a7b6fc200:17146] 1 exiting: rc = 0 00000100:00100000:1.0:1788813351.237485:0:17145:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff948a7b6fde00:17145] 0 exiting: rc = 1 00000100:00100000:0.0:1788813351.237683:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813351.238121:0:17149:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff948a7b6fc800:17149] 2 exiting: rc = 0 00000100:00100000:2.0:1788813351.238124:0:17147:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff948a7b6fd200:17147] 0 exiting: rc = 1 00000100:00100000:2.0:1788813351.238207:0:17148:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff948a7b6fd000:17148] 1 exiting: rc = 0 00000100:00100000:0.0:1788813351.238396:0:20304:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff948a4403d600:20304] 3 exiting: rc = 0 00000100:00100000:0.0:1788813351.238446:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238452:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238458:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238468:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238474:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238480:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238485:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238490:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238495:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238500:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238505:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238509:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238514:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238519:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238524:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238528:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238533:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238538:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238543:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238548:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238553:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238558:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238575:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238579:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238584:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238589:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238594:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238599:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238604:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238609:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238614:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238619:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238624:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238630:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238635:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238650:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238656:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238661:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238668:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238673:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238678:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238683:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238688:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238692:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238697:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238702:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238707:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238712:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238717:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238723:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238728:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238733:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238738:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238743:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238749:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238755:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238760:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238772:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238777:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238782:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238788:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238793:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238798:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.238803:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788813351.240055:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813351.240063:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788813351.240067:0:21338:0:(genops.c:885:class_export_put()) final put ffff9489436ee800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788813351.240071:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff9489436ee800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788813351.240075:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788813351.240115:0:21338:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7ccad800 1 00000020:00000080:2.0:1788813351.240119:0:21338:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703ddd 00000020:00000080:2.0:1788813351.240125:0:21338:0:(genops.c:885:class_export_put()) final put ffff948a44e13800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788813351.240137:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788813351.240141:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813351.240146:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788813351.240149:0:21338:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff948a506e3380) has no exports 00000020:00000080:1.0:1788813351.240163:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a44e13800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788813351.264147:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813351.264161:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788813351.264166:0:21338:0:(genops.c:885:class_export_put()) final put ffff948a4a56d000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788813351.264171:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff948a4a56d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788813351.264351:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788813351.264637:0:21338:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff948a4a56b000 00000020:01000000:2.0:1788813351.264810:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788813351.264815:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813351.264819:0:21338:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788813351.264824:0:21338:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff948a44763380) has no exports 00000020:00000080:2.0:1788813351.264850:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813351.264856:0:21338:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788813351.264859:0:21338:0:(genops.c:885:class_export_put()) final put ffff948943441800/OSS_uuid 00000020:00000080:2.0:1788813351.264861:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff948943441800/OSS_uuid for OSS 00000020:01000000:2.0:1788813351.264865:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788813351.265365:0:19191:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff948a4476d400:19191] 3 exiting: rc = 0 00000100:00100000:3.0:1788813351.265508:0:18670:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff948a6e903400:18670] 1 exiting: rc = 0 00000100:00100000:3.0:1788813351.265564:0:18668:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff948a6ea6c600:18668] 0 exiting: rc = 1 00000100:00080000:0.0:1788813351.265624:0:17158:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788813351.265803:0:19582:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff9489422a2400:19582] 4 exiting: rc = 0 00000100:00100000:0.0:1788813351.266267:0:18671:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff948a6e903800:18671] 2 exiting: rc = 0 00000100:00100000:2.0:1788813351.266446:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266455:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266460:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266465:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266469:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266475:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266480:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266484:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266489:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266494:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266501:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266505:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266510:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266516:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266554:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266560:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266565:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266571:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266577:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266582:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266587:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266591:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266597:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266601:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266615:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266621:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266625:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266630:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266634:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266639:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266645:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266650:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266722:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266727:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266731:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266736:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266741:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266747:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266752:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266756:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266762:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266767:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266773:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266778:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266784:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266789:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266794:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266799:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266805:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266810:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266816:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266821:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266825:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266830:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266835:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266840:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266845:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266851:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266856:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.266869:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.267155:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.267161:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.267167:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.267186:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.268835:0:18672:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff948a4a515800:18672] 0 exiting: rc = 1 00000100:00100000:3.0:1788813351.269907:0:18673:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff948a447e8c00:18673] 1 exiting: rc = 0 00000100:00100000:2.0:1788813351.270228:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270235:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270240:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270245:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270251:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270257:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270263:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270267:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270272:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270277:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270282:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270287:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270292:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270298:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270305:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270310:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270315:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270338:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270344:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270349:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270354:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270360:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270365:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270371:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270376:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270380:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270385:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270389:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270394:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270399:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270416:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270421:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270427:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270433:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270439:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270444:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270450:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270455:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270461:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270467:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270473:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270478:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270483:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270489:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270494:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270500:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270505:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270509:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270516:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270521:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270526:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270531:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270537:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270543:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270549:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270554:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270559:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270565:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270571:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270577:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270583:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270589:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270595:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.270601:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.272526:0:18676:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff948a6fa62200:18676] 2 exiting: rc = 0 00000100:00100000:0.0:1788813351.273124:0:18675:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff948a6fa62600:18675] 1 exiting: rc = 0 00000100:00100000:3.0:1788813351.273680:0:18674:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff948a63822200:18674] 0 exiting: rc = 1 00000100:00100000:2.0:1788813351.273885:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.273905:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.273911:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.273917:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.273924:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.273956:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.273965:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.273971:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.273978:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.273983:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.273989:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.273995:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274001:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274006:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274012:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274018:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274023:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274029:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274034:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274040:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274045:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274051:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274068:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274074:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274080:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274085:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274091:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274096:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274103:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274109:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274116:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274121:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274127:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274133:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274151:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274157:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274170:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274185:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274199:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274206:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274212:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274218:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274224:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274230:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274236:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274243:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274263:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274271:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274277:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274283:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274289:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274295:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274301:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274307:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274321:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274335:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274342:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274349:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274355:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274361:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274367:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274372:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274379:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.274385:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813351.278835:0:18677:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff948a44047400:18677] 0 exiting: rc = 1 00000100:00100000:0.0:1788813351.279504:0:18678:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff948a44046000:18678] 1 exiting: rc = 0 00000100:00100000:2.0:1788813351.279652:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279660:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279666:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279671:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279677:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279682:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279687:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279704:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279710:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279715:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279721:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279726:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279731:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279736:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279740:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279746:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279751:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279756:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279760:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279765:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279770:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279775:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279780:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279785:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279789:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279794:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279798:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279803:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279808:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279812:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279817:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279821:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279827:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279833:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279838:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279843:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279847:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279852:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279856:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279861:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279865:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.279870:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280005:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280010:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280015:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280020:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280025:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280030:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280035:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280040:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280045:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280050:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280054:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280059:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280064:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280069:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280074:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280080:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280089:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280094:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280099:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280104:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280109:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.280114:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813351.281243:0:18680:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff948a441c2c00:18680] 1 exiting: rc = 0 00000100:00100000:0.0:1788813351.281622:0:18679:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff948a441c2000:18679] 0 exiting: rc = 1 00000100:00100000:2.0:1788813351.281739:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281750:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281755:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281762:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281769:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281777:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281782:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281788:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281793:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281814:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281821:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281827:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281833:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281846:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281852:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281857:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281862:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.281868:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282108:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282117:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282122:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282265:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282272:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282278:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282284:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282290:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282296:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282301:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282307:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282313:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282318:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282325:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282331:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282352:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282360:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282365:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282371:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282377:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282383:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282389:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282394:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282400:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282405:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282412:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282417:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282438:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282444:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282449:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282462:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282468:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282474:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282480:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282486:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282492:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282498:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282504:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282510:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282530:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282537:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282542:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282548:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282553:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282559:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813351.282570:0:21338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788813351.299108:0:21338:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788813372.496683:0:22102:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788813382.379038:0:22702:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788813382.379045:0:22702:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788813382.379046:0:22702:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788813382.379147:0:22702:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9489430d0800 00000020:01000004:0.0:1788813382.379164:0:22702:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788813382.379171:0:22702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788813382.379185:0:22702:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff948a77938000) 00000020:00000080:0.0:1788813382.379200:0:22702:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788813382.438575:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.439136:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788813382.442317:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788813382.444037:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.444231:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.444477:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.444728:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.445043:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.445300:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.445613:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.445797:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.446109:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.446326:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.446684:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.446925:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.447241:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.447579:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.447766:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.448062:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.448302:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.448610:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.448834:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.449069:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.449287:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.449614:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.449793:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.450160:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.450342:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.450676:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.451006:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.451228:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.451512:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788813382.451721:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.451958:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.452176:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788813382.452739:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788813382.452956:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788813382.453169:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788813382.453388:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788813382.453716:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788813382.454198:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788813382.454515:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788813382.454735:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788813382.454924:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788813382.455171:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788813382.455510:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788813382.455754:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788813382.456627:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788813382.457273:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788813382.457533:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788813382.457926:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788813382.458209:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788813382.458425:0:22702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1788813382.458878:0:22702:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788813382.459204:0:22702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788813382.459215:0:22702:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788813382.459234:0:22702:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff7043e8 00000020:01000004:1.0:1788813382.459242:0:22702:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788813382.459247:0:22702:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788813382.459252:0:22702:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9489430d0800 from MGS 00000020:01000004:1.0:1788813382.459257:0:22702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788813382.459267:0:22702:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff948a6edb8000) 00000020:00000080:1.0:1788813382.459279:0:22702:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788813382.459365:0:22702:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9489430d0800 from MGS, refs=2 00080000:01000000:1.0:1788813382.459371:0:22702:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788813382.459376:0:22702:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff7043f6 00000100:00100000:1.0:1788813382.459482:0:22702:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788813382.459611:0:22702:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788813382.459617:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788813382.460504:0:22702:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788813382.460513:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788813382.461313:0:22702:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813382.461599:0:22702:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788813382.461605:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788813382.462362:0:22702:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788813382.462369:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788813382.462745:0:22702:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788813382.462751:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788813382.463580:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813382.463584:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813382.463585:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813382.463815:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813382.463818:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813382.463819:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813382.464386:0:22702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788813382.469039:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788813382.469292:0:22702:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788813382.474212:0:22714:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788813382.474376:0:22702:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788813382.474459:0:22702:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788813382.478675:0:22702:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788813382.479012:0:22702:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813382.479178:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788813382.479183:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788813382.479728:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788813382.479734:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788813382.480366:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788813382.480372:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1788813382.480970:0:22719:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788813382.481072:0:22702:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788813382.481089:0:22702:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.113@tcp' 00000020:01000004:1.0:1788813382.481091:0:22702:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788813382.481115:0:22702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.113@tcp (typ=mgc) 00000020:00000080:1.0:1788813382.481127:0:22702:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.113@tcp (ffff948a6edbb380) 00000020:00000080:1.0:1788813382.481137:0:22702:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788813382.481194:0:22702:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a7ccee800@MGC192.168.202.113@tcp: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813382.481309:0:22702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.113@tcp-0 is initialized 00000040:01000000:1.0:1788813382.481314:0:22702:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788813382.482228:0:22720:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788813382.482260:0:22702:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.113@tcp (uuid 151fd599-5695-4163-8caa-7faa559323aa) 00000020:00000080:0.0:1788813382.482276:0:22702:0:(genops.c:1384:class_connect()) connect: client 151fd599-5695-4163-8caa-7faa559323aa, cookie 0xf32533d6ff704404 00000100:00080000:0.0:1788813382.482287:0:22702:0:(import.c:545:import_select_connection()) MGC192.168.202.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788813382.482296:0:22702:0:(import.c:666:import_select_connection()) MGC192.168.202.113@tcp: import ffff948a7ccee800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813382.482332:0:22702:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489443b1c00 x1875706313395328/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813382.482345:0:22702:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 151fd599-5695-4163-8caa-7faa559323aa->MGS 00000020:01000004:0.0:1788813382.482358:0:22702:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788813382.482361:0:22702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788813382.482370:0:22702:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff948a7793cd40) 00000020:00000080:0.0:1788813382.482377:0:22702:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788813382.482513:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:151fd599-5695-4163-8caa-7faa559323aa:3624:1875706313395328:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788813382.482574:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813382.482638:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313395328 00000100:00100000:1.0:1788813382.482646:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313395328 00000100:00100000:1.0:1788813382.482671:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813382.482677:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3624:x1875706313395328:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788813382.482698:0:22716:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 151fd599-5695-4163-8caa-7faa559323aa@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:1.0:1788813382.482717:0:22716:0:(genops.c:1384:class_connect()) connect: client 151fd599-5695-4163-8caa-7faa559323aa, cookie 0xf32533d6ff704412 00000100:00080000:1.0:1788813382.482836:0:22716:0:(import.c:65:import_set_state_nolock()) ffff948a7cce8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813382.482904:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+5:3624:x1875706313395328:12345-0@lo:250:mount.lustre.0 Request processed in 226us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813382.482912:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813382.482969:0:3624:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788813382.482978:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.113@tcp: connect to target with instance 0 00000100:00080000:1.0:1788813382.482984:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788813382.482989:0:3624:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788813382.482994:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7ccee800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788813382.482996:0:3624:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788813382.483000:0:3624:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788813382.483004:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:151fd599-5695-4163-8caa-7faa559323aa:3624:1875706313395328:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788813382.502069:0:22702:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813382.502239:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788813382.502243:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788813382.503059:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788813382.503067:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788813382.503327:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788813382.503333:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788813382.503866:0:22702:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788813382.504134:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788813382.504137:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788813382.504391:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788813382.504448:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788813382.531151:0:22702:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813382.531364:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788813382.531372:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788813382.532168:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788813382.532175:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788813382.532677:0:22702:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813382.532806:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788813382.532812:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788813382.533338:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788813382.533343:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788813382.533766:0:22702:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813382.533976:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788813382.533980:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788813382.534372:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788813382.534378:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788813382.534730:0:22702:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813382.534860:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788813382.534864:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788813382.535339:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788813382.535344:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788813382.546200:0:22702:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813382.546353:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788813382.546358:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788813382.547226:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788813382.547237:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788813382.547772:0:22702:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788813382.547779:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788813382.548384:0:22702:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788813382.548412:0:22702:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788813382.548420:0:22702:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788813382.548518:0:22702:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788813382.548546:0:22702:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.113@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788813382.548549:0:22702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788813382.548550:0:22702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788813382.548552:0:22702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813382.548552:0:22702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813382.548553:0:22702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813382.548554:0:22702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813382.548555:0:22702:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788813382.548556:0:22702:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788813382.548557:0:22702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813382.548558:0:22702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788813382.548560:0:22702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788813382.548561:0:22702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788813382.548562:0:22702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788813382.548562:0:22702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813382.548563:0:22702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813382.548563:0:22702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813382.548564:0:22702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813382.548565:0:22702:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788813382.548565:0:22702:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788813382.548566:0:22702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813382.548566:0:22702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788813382.548655:0:22702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788813382.548673:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313395456:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788813382.548727:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813382.548775:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313395456 00000100:00100000:1.0:1788813382.548780:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4a7919c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813382.548783:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313395456 00000100:00100000:3.0:1788813382.548828:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813382.548838:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+5:22702:x1875706313395456:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788813382.548907:0:22718:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788813382.548911:0:22718:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788813382.548915:0:22718:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788813382.552542:0:22739:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788813382.553199:0:22718:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1788813382.554389:0:22740:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788813382.554393:0:22740:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788813382.554403:0:22740:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788813382.554406:0:22740:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788813382.554543:0:22740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788813382.554731:0:22718:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788813382.554739:0:22718:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788813382.556727:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+5:22702:x1875706313395456:12345-0@lo:253:mount.lustre.0 Request processed in 7884us (7991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813382.556739:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813382.556968:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313395456:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788813382.556980:0:22702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788813382.556983:0:22702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788813382.556984:0:22702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788813382.556985:0:22702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813382.556986:0:22702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813382.556987:0:22702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813382.556987:0:22702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813382.556988:0:22702:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788813382.556989:0:22702:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788813382.556990:0:22702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813382.556991:0:22702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788813382.557006:0:22702:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9489430d0800 from lustre-MDT0000 10000000:01000000:3.0:1788813382.557030:0:22702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788813382.557032:0:22702:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788813382.557035:0:22702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff948a6edbb380 10000000:01000000:3.0:1788813382.557038:0:22702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788813382.557045:0:22702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff948a6edbb380 from 1 10000000:01000000:3.0:1788813382.557047:0:22702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788813382.557083:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.557091:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.557098:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813382.557128:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313395584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813382.557157:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813382.557194:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813382.557207:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313395584 00000100:00100000:1.0:1788813382.557214:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313395584 00000100:00100000:1.0:1788813382.557250:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813382.557259:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+5:22702:x1875706313395584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813382.557271:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813382.557284:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8c00/0xf32533d6ff704420 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff704419 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813382.557309:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8c00/0xf32533d6ff704420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff704419 expref: 6 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813382.557319:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8c00/0xf32533d6ff704420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704419 expref: 6 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813382.557327:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8c00, rc 0) 00000100:00100000:1.0:1788813382.557409:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+6:22702:x1875706313395584:12345-0@lo:101:mount.lustre.0 Request processed in 151us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813382.557416:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813382.557472:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313395584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813382.557485:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704420 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.557493:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff704420 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813382.557545:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943126680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313395712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813382.557572:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813382.557695:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a64094480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813382.557735:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313395712 00000100:00100000:1.0:1788813382.557739:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313395712 00000100:00100000:1.0:1788813382.557802:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813382.557810:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+6:22702:x1875706313395712:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813382.557920:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+6:22702:x1875706313395712:12345-0@lo:501:mount.lustre.0 Request processed in 110us (346us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813382.557927:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813382.558050:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943126680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313395712:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788813382.558081:0:22702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788813382.558092:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704420 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.558100:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704420 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813382.558107:0:22702:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9489430d0800 10000000:01000000:3.0:1788813382.558111:0:22702:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788813382.558115:0:22702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9489430d0800 10000000:01000000:3.0:1788813382.558117:0:22702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788813382.558120:0:22702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9489430d0800 from 1 10000000:01000000:3.0:1788813382.558122:0:22702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788813382.558139:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4a00/0xf32533d6ff704427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.558146:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a821e4a00/0xf32533d6ff704427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.558154:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a821e4a00/0xf32533d6ff704427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813382.558165:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313395840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813382.558199:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813382.558496:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813382.558655:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313395840 00000100:00100000:2.0:1788813382.558661:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313395840 00000100:00100000:2.0:1788813382.558689:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788813382.558697:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+6:22702:x1875706313395840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813382.558707:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813382.558721:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948941a81200/0xf32533d6ff70442e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff704427 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.558739:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948941a81200/0xf32533d6ff70442e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff704427 expref: 7 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.558748:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948941a81200/0xf32533d6ff70442e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704427 expref: 7 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.558755:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948941a81200, rc 0) 00000100:00100000:2.0:1788813382.558806:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+7:22702:x1875706313395840:12345-0@lo:101:mount.lustre.0 Request processed in 110us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813382.558812:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813382.559013:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313395840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813382.559027:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a821e4a00/0xf32533d6ff704427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70442e expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.559037:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a821e4a00/0xf32533d6ff704427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70442e expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813382.559050:0:22702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788813382.559063:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4a00/0xf32533d6ff704427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70442e expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.559070:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a821e4a00/0xf32533d6ff704427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70442e expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813382.559076:0:22702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788813382.559080:0:22702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788813382.559085:0:22702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9489430d0800 10000000:01000000:3.0:1788813382.559087:0:22702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788813382.559090:0:22702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788813382.559093:0:22702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788813382.559108:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff704435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.559114:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff704435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.559121:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff704435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813382.559142:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313395968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813382.559169:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813382.559193:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813382.559250:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313395968 00000100:00100000:2.0:1788813382.559255:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313395968 00000100:00100000:2.0:1788813382.559274:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813382.559280:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+7:22702:x1875706313395968:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813382.559288:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813382.559296:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948941a80800/0xf32533d6ff70443c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff704435 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.559310:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948941a80800/0xf32533d6ff70443c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff704435 expref: 8 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.559317:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948941a80800/0xf32533d6ff70443c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704435 expref: 8 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.559330:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948941a80800, rc 0) 00000100:00100000:2.0:1788813382.559367:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+8:22702:x1875706313395968:12345-0@lo:101:mount.lustre.0 Request processed in 87us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813382.559373:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788813382.559433:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313395968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813382.559444:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff704435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70443c expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.559452:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff704435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70443c expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813382.559500:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313396096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813382.559525:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813382.559547:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813382.559597:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313396096 00000100:00100000:2.0:1788813382.559601:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313396096 00000100:00100000:2.0:1788813382.559616:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813382.559621:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+8:22702:x1875706313396096:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813382.559758:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+9:22702:x1875706313396096:12345-0@lo:501:mount.lustre.0 Request processed in 135us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813382.559984:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313396096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813382.560012:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313396224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813382.560050:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813382.560065:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813382.560118:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813382.560137:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313396224 00000100:00100000:2.0:1788813382.560140:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313396224 00000100:00100000:2.0:1788813382.560154:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813382.560160:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+9:22702:x1875706313396224:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813382.561374:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+9:22702:x1875706313396224:12345-0@lo:503:mount.lustre.0 Request processed in 1209us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813382.561385:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813382.561517:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313396224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813382.562210:0:22741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:151fd599-5695-4163-8caa-7faa559323aa:22741:1875706313396352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813382.562261:0:22741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813382.562326:0:22741:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ebfdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788813382.562365:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313396352 00000100:00100000:3.0:1788813382.562372:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313396352 00000100:00100000:3.0:1788813382.562438:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813382.562447:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+9:22741:x1875706313396352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813382.563237:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+9:22741:x1875706313396352:12345-0@lo:502:llog_process_th.0 Request processed in 788us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813382.563256:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813382.563272:0:22741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:151fd599-5695-4163-8caa-7faa559323aa:22741:1875706313396352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813382.563299:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813382.563310:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813382.563312:0:22741:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788813382.563319:0:22741:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788813382.563322:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813382.563336:0:22741:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff948a6edbcd40) 00000020:00000080:1.0:1788813382.563353:0:22741:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788813382.563358:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788813382.563427:0:22741:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788813382.563434:0:22741:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff70444a 00000020:00000080:1.0:1788813382.563721:0:22741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788813382.563726:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813382.563730:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813382.563731:0:22741:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788813382.563734:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813382.563737:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813382.563739:0:22741:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788813382.563742:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813382.563750:0:22741:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff948a6edb99c0) 00000020:00000080:1.0:1788813382.563759:0:22741:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788813382.563832:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788813382.563835:0:22741:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788813382.563845:0:22741:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788813382.563853:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788813382.563915:0:22741:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9489430d0800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788813382.563929:0:22741:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff948a506e3380) 00000020:00000080:1.0:1788813382.563967:0:22741:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788813382.564034:0:22741:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788813382.564039:0:22741:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff70445f 00000020:00000080:1.0:1788813382.564131:0:22741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788813382.564137:0:22741:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788813382.564141:0:22741:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf32533d6ff704466 00080000:01000000:1.0:1788813382.564146:0:22741:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788813382.564150:0:22741:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff70446d 00010000:00010000:2.0:1788813382.611623:0:22741:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788813382.612124:0:22741:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:2.0:1788813382.612414:0:22741:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788813382.612868:0:22741:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff948a44764d40) 00000020:00000080:2.0:1788813382.612900:0:22741:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788813382.613008:0:22741:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788813382.613015:0:22741:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff70447b 00000020:00000080:0.0:1788813382.613477:0:22741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788813382.616871:0:22741:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf32533d6ff704482 00000020:00000080:0.0:1788813382.617310:0:22741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788813382.617322:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813382.617330:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813382.617332:0:22741:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788813382.617335:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788813382.617338:0:22741:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788813382.617340:0:22741:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788813382.617341:0:22741:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788813382.617342:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788813382.617346:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813382.617352:0:22741:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788813382.617357:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813382.617362:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813382.617363:0:22741:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788813382.617367:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788813382.617405:0:22741:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788813382.617420:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813382.617424:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813382.617425:0:22741:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788813382.617427:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813382.617430:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813382.617432:0:22741:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788813382.617434:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788813382.617439:0:22741:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:00000080:0.0:1788813382.617464:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788813382.617481:0:22741:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff948a7793b380) 00000020:00000080:0.0:1788813382.617494:0:22741:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788813382.617498:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788813382.617549:0:22741:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788813382.617554:0:22741:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788813382.617560:0:22741:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff704490 00010000:00080000:0.0:1788813382.617593:0:22741:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a50e3f800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.113@tcp at head 00010000:00010000:0.0:1788813382.623804:0:22741:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788813382.626173:0:22741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788813382.626187:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788813382.626227:0:22741:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788813382.626246:0:22741:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff704497 00000100:00080000:1.0:1788813382.626256:0:22741:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813382.626267:0:22741:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948a50e3f800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813382.626300:0:22741:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94894348b800 x1875706313396480/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813382.626449:0:22741:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788813382.626525:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813382.626529:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813382.626531:0:22741:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788813382.626534:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788813382.626537:0:22741:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788813382.626539:0:22741:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813382.626540:0:22741:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813382.626541:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788813382.626544:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813382.626545:0:22741:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788813382.626548:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813382.626559:0:22741:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788813382.626563:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813382.626564:0:22741:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788813382.626567:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788813382.626572:0:22741:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:01000000:1.0:1788813382.626995:0:22741:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788813382.626999:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813382.627012:0:22741:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff948a506e0000) 00000100:00100000:2.0:1788813382.627025:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313396480:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1788813382.627088:0:22741:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788813382.627094:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1788813382.627097:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788813382.627159:0:22741:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788813382.627165:0:22741:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788813382.627171:0:22741:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff7044a5 00010000:00080000:1.0:1788813382.627201:0:22741:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9489437d8800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.113@tcp at head 00000100:00100000:0.0:1788813382.627206:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313396480 00000100:00100000:0.0:1788813382.627214:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313396480 00000100:00100000:0.0:1788813382.627284:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813382.627292:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1875706313396480:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788813382.627307:0:22728:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:1.0:1788813382.632207:0:22741:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788813382.636144:0:22741:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788813382.636838:0:22741:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788813382.639233:0:22741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813382.639476:0:22741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788813382.647305:0:22741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1788813382.648387:0:22747:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788813382.648392:0:22747:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788813382.650758:0:22741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788813382.650786:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788813382.650828:0:22741:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788813382.650858:0:22741:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff7044ac 00000100:00080000:1.0:1788813382.650869:0:22741:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813382.650911:0:22741:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9489437d8800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813382.651155:0:22741:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94894348a300 x1875706313396608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813382.651179:0:22741:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788813382.651282:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313396608:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788813382.651337:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313396608 offset 0 length 520: 4 00000020:01000000:1.0:1788813382.651789:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813382.651806:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813382.651808:0:22741:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788813382.651812:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788813382.651815:0:22741:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788813382.651817:0:22741:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813382.651818:0:22741:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813382.651820:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788813382.651822:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813382.651824:0:22741:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788813382.651827:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813382.651831:0:22741:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788813382.651834:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813382.651836:0:22741:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788813382.651839:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788813382.651842:0:22741:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:01000000:1.0:1788813382.651873:0:22741:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788813382.651876:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813382.651897:0:22741:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff948a506e19c0) 00000020:00000080:1.0:1788813382.651912:0:22741:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788813382.651918:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788813382.652013:0:22741:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788813382.652019:0:22741:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788813382.652025:0:22741:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff7044ba 00010000:00080000:1.0:1788813382.652055:0:22741:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a7b57d800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813382.652273:0:22741:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788813382.652344:0:22741:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788813382.652361:0:22741:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788813382.654606:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1875706313396480:12345-0@lo:38:llog_process_th.0 Request processed in 27303us (27498us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788813382.654645:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788813382.654702:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a50e3f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813382.654707:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788813382.654711:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313396480:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788813382.657162:0:22741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813382.657516:0:22741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788813382.657627:0:22741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1788813382.658353:0:22749:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788813382.658358:0:22749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788813382.662723:0:22741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788813382.662747:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788813382.662810:0:22741:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788813382.662835:0:22741:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff7044c1 00000100:00080000:1.0:1788813382.663223:0:22741:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813382.663237:0:22741:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948a7b57d800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813382.663291:0:22741:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94894348b800 x1875706313396736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813382.663358:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313396736:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788813382.663413:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313396736 offset 0 length 520: 4 00000100:00080000:1.0:1788813382.663473:0:22741:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788813382.663533:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813382.663538:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813382.663540:0:22741:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788813382.663543:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813382.663547:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813382.663548:0:22741:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788813382.663551:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788813382.663552:0:22741:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788813382.663554:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813382.663556:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813382.663558:0:22741:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788813382.663560:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813382.663562:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813382.663563:0:22741:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788813382.663566:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788813382.663597:0:22741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:151fd599-5695-4163-8caa-7faa559323aa:22741:1875706313396864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813382.663645:0:22741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813382.663663:0:22741:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48e44c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813382.664165:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313396864 00000100:00100000:0.0:1788813382.664174:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313396864 00000100:00100000:0.0:1788813382.664233:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788813382.664241:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+9:22741:x1875706313396864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813382.664366:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+9:22741:x1875706313396864:12345-0@lo:502:llog_process_th.0 Request processed in 125us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813382.664374:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813382.664577:0:22741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:151fd599-5695-4163-8caa-7faa559323aa:22741:1875706313396864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813382.664605:0:22741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813382.664610:0:22741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813382.664612:0:22741:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788813382.664622:0:22741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788813382.664806:0:22702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788813382.664828:0:22702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788813382.664864:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff704435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70443c expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.664875:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff704435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70443c expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813382.664891:0:22702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9489430d0800 from 1 10000000:01000000:3.0:1788813382.664894:0:22702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788813382.664921:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5200/0xf32533d6ff7044c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.664957:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a821e5200/0xf32533d6ff7044c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.664968:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a821e5200/0xf32533d6ff7044c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813382.664985:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313396992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813382.665017:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813382.665044:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813382.665228:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313396992 00000100:00100000:1.0:1788813382.665234:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313396992 00000100:00100000:1.0:1788813382.665265:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813382.665272:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+9:22702:x1875706313396992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813382.665281:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813382.665293:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff7044cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7044c8 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813382.665313:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff7044cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7044c8 expref: 10 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813382.665324:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff7044cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7044c8 expref: 10 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813382.665332:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9000, rc 0) 00000100:00100000:1.0:1788813382.665364:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+10:22702:x1875706313396992:12345-0@lo:101:mount.lustre.0 Request processed in 93us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813382.665370:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788813382.665499:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313396992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813382.665512:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a821e5200/0xf32533d6ff7044c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7044cf expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.665534:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a821e5200/0xf32533d6ff7044c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7044cf expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813382.666302:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313397120:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788813382.666345:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813382.666415:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813382.666694:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313397120 00000100:00100000:1.0:1788813382.666701:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313397120 00000100:00100000:1.0:1788813382.666781:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813382.666789:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+10:22702:x1875706313397120:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788813382.666806:0:22716:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788813382.666812:0:22716:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788813382.667486:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+10:22702:x1875706313397120:12345-0@lo:256:mount.lustre.0 Request processed in 695us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813382.667496:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788813382.667598:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313397120:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788813382.668236:0:22702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788813382.668252:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5200/0xf32533d6ff7044c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7044cf expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813382.668264:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a821e5200/0xf32533d6ff7044c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7044cf expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813382.668272:0:22702:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9489430d0800 from 1 10000000:01000000:0.0:1788813382.668275:0:22702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813382.668309:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166f400/0xf32533d6ff7044d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813382.668317:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a4166f400/0xf32533d6ff7044d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813382.668326:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a4166f400/0xf32533d6ff7044d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813382.668344:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313397248:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813382.668384:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813382.669427:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813382.669520:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313397248 00000100:00100000:3.0:1788813382.669529:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313397248 00000100:00100000:3.0:1788813382.669573:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813382.669583:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+10:22702:x1875706313397248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813382.669599:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813382.669618:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a821e5400/0xf32533d6ff7044dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7044d6 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.669642:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e5400/0xf32533d6ff7044dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7044d6 expref: 11 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.669652:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a821e5400/0xf32533d6ff7044dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7044d6 expref: 11 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.669660:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e5400, rc 0) 00000100:00100000:3.0:1788813382.669712:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+11:22702:x1875706313397248:12345-0@lo:101:mount.lustre.0 Request processed in 130us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813382.669719:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813382.670248:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313397248:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813382.670314:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a4166f400/0xf32533d6ff7044d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7044dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813382.670324:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a4166f400/0xf32533d6ff7044d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7044dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813382.670400:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313397376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813382.670435:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813382.670457:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813382.670520:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313397376 00000100:00100000:3.0:1788813382.670525:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313397376 00000100:00100000:3.0:1788813382.670546:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788813382.670560:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+11:22702:x1875706313397376:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813382.670719:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+11:22702:x1875706313397376:12345-0@lo:501:mount.lustre.0 Request processed in 159us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813382.670726:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813382.671065:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313397376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813382.671095:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313397504:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813382.671135:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813382.671152:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813382.671202:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313397504 00000100:00100000:1.0:1788813382.671214:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313397504 00000100:00100000:1.0:1788813382.671235:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813382.671242:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+11:22702:x1875706313397504:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813382.671323:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+11:22702:x1875706313397504:12345-0@lo:503:mount.lustre.0 Request processed in 82us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813382.671329:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788813382.671400:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313397504:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813382.671717:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:151fd599-5695-4163-8caa-7faa559323aa:22751:1875706313397632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813382.671748:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813382.671778:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788813382.672099:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313397632 00000100:00100000:1.0:1788813382.672104:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313397632 00000100:00100000:1.0:1788813382.672125:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813382.672130:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+11:22751:x1875706313397632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813382.673100:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+11:22751:x1875706313397632:12345-0@lo:502:llog_process_th.0 Request processed in 967us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813382.673109:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788813382.673238:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:151fd599-5695-4163-8caa-7faa559323aa:22751:1875706313397632:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788813382.673268:0:22751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813382.673279:0:22751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813382.673281:0:22751:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788813382.673287:0:22751:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9489430d0800 00000020:00000080:0.0:1788813382.673290:0:22751:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813382.673298:0:22751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813382.673300:0:22751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813382.673302:0:22751:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788813382.673312:0:22751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813382.673315:0:22751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813382.673317:0:22751:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788813382.673320:0:22751:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9489430d0800 00000020:00000080:0.0:1788813382.673323:0:22751:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813382.673387:0:22751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813382.673391:0:22751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813382.673392:0:22751:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788813382.673394:0:22751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813382.673397:0:22751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813382.673398:0:22751:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788813382.673402:0:22751:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9489430d0800 00000020:00000080:0.0:1788813382.673404:0:22751:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813382.673421:0:22751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813382.673424:0:22751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813382.673425:0:22751:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788813382.673427:0:22751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813382.673430:0:22751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813382.673431:0:22751:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788813382.673435:0:22751:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9489430d0800 00000020:00000080:0.0:1788813382.673437:0:22751:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788813382.673482:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:151fd599-5695-4163-8caa-7faa559323aa:22751:1875706313397760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813382.673524:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813382.673552:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813382.673632:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313397760 00000100:00100000:2.0:1788813382.673639:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313397760 00000100:00100000:2.0:1788813382.673682:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788813382.673691:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+11:22751:x1875706313397760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813382.673795:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+11:22751:x1875706313397760:12345-0@lo:502:llog_process_th.0 Request processed in 105us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813382.673801:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788813382.674119:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:151fd599-5695-4163-8caa-7faa559323aa:22751:1875706313397760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788813382.674141:0:22751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813382.674146:0:22751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813382.674148:0:22751:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788813382.674151:0:22751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788813382.674454:0:22702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788813382.674476:0:22702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813382.674498:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166f400/0xf32533d6ff7044d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7044dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.674509:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4166f400/0xf32533d6ff7044d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7044dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813382.674569:0:22702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788813382.674572:0:22702:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9489430d0800 10000000:01000000:2.0:1788813382.674575:0:22702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9489430d0800 10000000:01000000:2.0:1788813382.674579:0:22702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788813382.674585:0:22702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9489430d0800 from 1 10000000:01000000:2.0:1788813382.674588:0:22702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788813382.674619:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a81c00/0xf32533d6ff7044e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.674627:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948941a81c00/0xf32533d6ff7044e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.674635:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948941a81c00/0xf32533d6ff7044e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813382.674652:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943126300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313397888:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788813382.674694:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813382.674724:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a60870a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813382.674739:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313397888 00000100:00100000:2.0:1788813382.674744:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313397888 00000100:00100000:2.0:1788813382.675040:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788813382.675048:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+11:22702:x1875706313397888:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813382.675060:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813382.675072:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948941a80400/0xf32533d6ff7044eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7044e4 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.675095:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948941a80400/0xf32533d6ff7044eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7044e4 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.675118:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948941a80400/0xf32533d6ff7044eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7044e4 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.675128:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948941a80400, rc 0) 00000100:00100000:2.0:1788813382.675163:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+12:22702:x1875706313397888:12345-0@lo:101:mount.lustre.0 Request processed in 116us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813382.675170:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788813382.675210:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943126300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313397888:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813382.675222:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948941a81c00/0xf32533d6ff7044e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7044eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.675232:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948941a81c00/0xf32533d6ff7044e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7044eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813382.675283:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943126300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313398016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813382.675308:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813382.675320:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a60870a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813382.676894:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313398016 00000100:00100000:3.0:1788813382.676907:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313398016 00000100:00100000:3.0:1788813382.676984:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788813382.676995:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+12:22702:x1875706313398016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813382.677162:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+12:22702:x1875706313398016:12345-0@lo:501:mount.lustre.0 Request processed in 169us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813382.677169:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813382.677293:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943126300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313398016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813382.677344:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313398144:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813382.677395:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813382.677421:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4840 going to sleep for 11 seconds 00000100:00100000:3.0:1788813382.677539:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313398144 00000100:00100000:3.0:1788813382.677544:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313398144 00000100:00100000:3.0:1788813382.677574:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788813382.677580:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+12:22702:x1875706313398144:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813382.677656:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+12:22702:x1875706313398144:12345-0@lo:503:mount.lustre.0 Request processed in 75us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813382.677663:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813382.677744:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313398144:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813382.678241:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:151fd599-5695-4163-8caa-7faa559323aa:22752:1875706313398272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813382.678274:0:22752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813382.678300:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813382.678341:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313398272 00000100:00100000:0.0:1788813382.678345:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313398272 00000100:00100000:0.0:1788813382.678376:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788813382.678383:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+12:22752:x1875706313398272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813382.678463:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+12:22752:x1875706313398272:12345-0@lo:502:llog_process_th.0 Request processed in 79us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813382.678469:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813382.678872:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:151fd599-5695-4163-8caa-7faa559323aa:22752:1875706313398272:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788813382.678970:0:22752:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788813382.678988:0:22752:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff948a6adb4d40) 00000020:00000080:3.0:1788813382.679008:0:22752:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788813382.679094:0:22752:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9489430d0800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788813382.679099:0:22752:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9489430d0800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788813382.679103:0:22752:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9489430d0800 4 00010000:00080000:3.0:1788813382.679135:0:22752:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94894344c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.113@tcp at head 00010000:00010000:3.0:1788813382.680760:0:22752:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788813382.680997:0:22752:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788813382.681036:0:22752:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788813382.681051:0:22752:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf32533d6ff7044f9 00000100:00080000:3.0:1788813382.681061:0:22752:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788813382.681072:0:22752:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff94894344c000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813382.681110:0:22752:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a6eda7100 x1875706313398400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813382.681133:0:22752:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788813382.682261:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313398400:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788813382.682333:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813382.682450:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313398400 00000100:00100000:0.0:1788813382.682458:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313398400 00000100:00100000:0.0:1788813382.682499:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813382.682507:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1875706313398400:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788813382.682566:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1875706313398400:12345-0@lo:38:llog_process_th.0 Request processed in 58us (232us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788813382.682573:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813382.682651:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788813382.682660:0:3624:0:(import.c:65:import_set_state_nolock()) ffff94894344c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813382.682665:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788813382.682668:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313398400:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788813382.700139:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:151fd599-5695-4163-8caa-7faa559323aa:22752:1875706313398528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813382.700223:0:22752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813382.700274:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313398528 00000100:00100000:3.0:1788813382.700281:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313398528 00000100:00100000:3.0:1788813382.700325:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788813382.700334:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+12:22752:x1875706313398528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813382.700441:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+12:22752:x1875706313398528:12345-0@lo:502:llog_process_th.0 Request processed in 107us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813382.700449:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788813382.700498:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788813382.700520:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:151fd599-5695-4163-8caa-7faa559323aa:22752:1875706313398528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813382.700560:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:151fd599-5695-4163-8caa-7faa559323aa:22752:1875706313398656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813382.700589:0:22752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813382.700617:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313398656 00000100:00100000:3.0:1788813382.700622:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313398656 00000100:00100000:3.0:1788813382.700642:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788813382.700648:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+12:22752:x1875706313398656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813382.700705:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+12:22752:x1875706313398656:12345-0@lo:502:llog_process_th.0 Request processed in 57us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813382.700710:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788813382.700734:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788813382.700744:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:151fd599-5695-4163-8caa-7faa559323aa:22752:1875706313398656:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788813382.700761:0:22752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788813382.708197:0:22702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788813382.708250:0:22702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788813382.708327:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a81c00/0xf32533d6ff7044e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7044eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813382.708341:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948941a81c00/0xf32533d6ff7044e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7044eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788813382.708552:0:22702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788813382.708554:0:22702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788813382.708562:0:22702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813382.708563:0:22702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813382.708564:0:22702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813382.708565:0:22702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813382.708566:0:22702:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788813382.708568:0:22702:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788813382.708569:0:22702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813382.708570:0:22702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788813382.708574:0:22702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788813382.708576:0:22702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788813382.708577:0:22702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788813382.708578:0:22702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813382.708579:0:22702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813382.708580:0:22702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813382.708581:0:22702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813382.708582:0:22702:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788813382.708583:0:22702:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788813382.708583:0:22702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813382.708584:0:22702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788813382.708611:0:22702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788813382.708632:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313398784:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788813382.708716:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813382.708760:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813382.709268:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313398784 00000100:00100000:3.0:1788813382.709276:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313398784 00000100:00100000:3.0:1788813382.709318:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788813382.709326:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+12:22702:x1875706313398784:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788813382.709354:0:22716:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788813382.709368:0:22716:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788813382.712282:0:22716:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788813382.712299:0:22716:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788813382.712419:0:22739:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788813382.712424:0:22739:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788813382.712446:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704500 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.712466:0:22739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff7044cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7044c8 expref: 12 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.712474:0:22739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704500 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.712513:0:22739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff7044cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7044c8 expref: 12 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.712539:0:22739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff7044cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7044c8 expref: 12 pid: 22718 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813382.712554:0:22739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22739:1875706313398912:0@lo:104: 00000100:00100000:3.0:1788813382.712618:0:22739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813382.712666:0:22739:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788813382.713175:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+12:22702:x1875706313398784:12345-0@lo:253:mount.lustre.0 Request processed in 3847us (4455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813382.713185:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813382.714163:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313398912 00000100:00100000:2.0:1788813382.714174:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313398912 00000100:00100000:2.0:1788813382.714248:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813382.714257:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+3:22739:x1875706313398912:12345-0@lo:104: 00010000:00010000:2.0:1788813382.714272:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a821e5200/0xf32533d6ff7044c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7044cf expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.714333:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788813382.714339:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+3:22739:x1875706313398912:12345-0@lo:104: Request processed in 84us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813382.714346:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813382.714659:0:22739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22739:1875706313398912:0@lo:104: 00010000:00010000:3.0:1788813382.714757:0:22739:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704500 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.714777:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813382.714783:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a821e5200/0xf32533d6ff7044c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7044cf expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.714790:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5200 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813382.714794:0:22712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a821e5200/0xf32533d6ff7044c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7044cf expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.714802:0:22712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a821e5200/0xf32533d6ff7044c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7044cf expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813382.714810:0:22712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a821e5200/0xf32533d6ff7044c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7044cf expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813382.714817:0:22712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813382.714872:0:22712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a821e5200/0xf32533d6ff7044c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7044cf expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.714887:0:22712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813382.714907:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a821e5200/0xf32533d6ff7044c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7044cf expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.714914:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a821e5200/0xf32533d6ff7044c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7044cf expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.714954:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813382.714956:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813382.714958:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813382.714987:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313399040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813382.715023:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813382.716360:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:22702:1875706313398784:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788813382.716379:0:22702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788813382.716382:0:22702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788813382.716384:0:22702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788813382.716385:0:22702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813382.716387:0:22702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813382.716388:0:22702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813382.716389:0:22702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813382.716390:0:22702:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788813382.716392:0:22702:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788813382.716394:0:22702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813382.716395:0:22702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788813382.716407:0:22702:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788813382.717072:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313399040 00000100:00100000:2.0:1788813382.717082:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313399040 00010000:00010000:2.0:1788813382.717116:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff7044cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7044c8 expref: 12 pid: 22718 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813382.717155:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813382.717163:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:151fd599-5695-4163-8caa-7faa559323aa+12:3627:x1875706313399040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813382.717175:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813382.717181:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff7044cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7044c8 expref: 12 pid: 22718 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.717193:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff7044cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7044c8 expref: 12 pid: 22718 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.717212:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff7044cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7044c8 expref: 12 pid: 22718 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.717226:0:22708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704500 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.717235:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704500 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788813382.717258:0:22708:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004833932s 00010000:00010000:2.0:1788813382.717262:0:22708:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704500 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.717269:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704500 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.717276:0:22708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704500 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.717283:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704500 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.717289:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4c00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813382.717293:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704500 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.717301:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704500 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.717314:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704500 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813382.717326:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813382.717386:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:151fd599-5695-4163-8caa-7faa559323aa+11:3627:x1875706313399040:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (2363us total) trans 0 rc 0/0 00010000:00010000:3.0:1788813382.718822:0:22739:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704500 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813382.718838:0:22739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704500 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813382.718920:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788813382.718956:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704500 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813382.719002:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313399040:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788813382.741781:0:22702:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:0.0:1788813382.743289:0:22702:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788813382.743655:0:22763:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1788813382.743661:0:22763:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:1.0:1788813382.752026:0:22764:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788813382.752030:0:22702:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788813382.752436:0:22764:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1788813382.753278:0:22765:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff948943125f80 x1875706313399168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813382.753304:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00000040:01000000:0.0:1788813382.753787:0:22702:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788813382.753816:0:22702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788813382.754508:0:22702:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788813382.754516:0:22702:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788813382.754557:0:22702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813382.756205:0:22702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788813382.758588:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:00080000:0.0:1788813382.758644:0:22702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000004:00080000:1.0:1788813382.758660:0:22764:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1788813382.758688:0:22702:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788813382.771250:0:22702:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788813382.772007:0:22702:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1788813382.776924:0:22702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788813382.783401:0:22702:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788813382.783441:0:22702:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb26500d1f988 00100000:10000000:0.0:1788813382.783463:0:22702:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788813382.786074:0:22702:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788813382.786096:0:22702:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.113@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788813382.786116:0:22702:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788813382.786140:0:22702:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788813382.787089:0:22702:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788813382.787291:0:22702:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788813383.524015:0:22720:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788813383.524024:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9489430d0800 from 11 10000000:01000000:2.0:1788813383.524030:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788813383.524082:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff704507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813383.524094:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff704507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813383.524106:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff704507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813383.524135:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943125880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313399296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813383.524206:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813383.524258:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48c069c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788813383.524422:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813383.524450:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313399296 00000100:00100000:3.0:1788813383.524459:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313399296 00000100:00100000:3.0:1788813383.524521:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788813383.524530:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+11:22720:x1875706313399296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813383.524543:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813383.524569:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a821e4c00/0xf32533d6ff70450e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff704507 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813383.524679:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e4c00/0xf32533d6ff70450e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff704507 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813383.524690:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a821e4c00/0xf32533d6ff70450e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704507 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813383.524698:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4c00, rc 0) 00000100:00100000:3.0:1788813383.524746:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+12:22720:x1875706313399296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813383.524753:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813383.525268:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943125880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313399296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813383.525283:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff704507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70450e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813383.525292:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff704507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70450e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813383.525348:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943125880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313399424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788813383.525412:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813383.525455:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48c069c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813383.525599:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313399424 00000100:00100000:1.0:1788813383.525607:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313399424 00000100:00100000:1.0:1788813383.525651:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788813383.525659:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a4a623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+12:22720:x1875706313399424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788813383.525677:0:22716:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788813383.525700:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788813383.525703:0:22716:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788813383.525801:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a4a623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+12:22720:x1875706313399424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813383.525809:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788813383.525917:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943125880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313399424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788813383.526020:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788813383.526028:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff704507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70450e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813383.526037:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff704507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70450e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813383.789616:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00000040:00080000:1.0:1788813383.806025:0:22759:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788813383.806037:0:22759:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813383.808425:0:22759:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788813383.808440:0:22759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788813384.548214:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813384.804997:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00000040:00080000:2.0:1788813384.891709:0:22759:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788813384.891719:0:22759:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813384.893221:0:22759:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1788813384.893286:0:22759:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813384.893817:0:22759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:2.0:1788813385.581365:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813385.830079:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00010000:00010000:2.0:1788813386.596157:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813386.854234:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00010000:00010000:2.0:1788813387.624207:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813387.877712:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00000001:02000400:0.0:1788813387.917886:0:23008:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788813388.137736:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788813388.137744:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788813388.137748:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a50e3f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813388.137755:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 535 00000100:00080000:2.0:1788813388.137762:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788813388.137774:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948a50e3f800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813388.137796:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948943127100 x1875706313399680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788813388.137814:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813388.137817:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813388.137820:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813388.137823:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813388.137826:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788813388.137840:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788813388.137842:0:36:0:(import.c:65:import_set_state_nolock()) ffff94894344c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813388.137861:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff94894344c000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813388.137877:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948943125500 x1875706313399808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813388.137906:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313399680:0@lo:38:kworker.0 00000100:00100000:2.0:1788813388.139428:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813388.139500:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313399808:0@lo:38:kworker.0 00000100:00100000:2.0:1788813388.139535:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813388.139601:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313399680 00000100:00100000:2.0:1788813388.139612:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313399680 00000100:00100000:2.0:1788813388.139650:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813388.139658:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875706313399680:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788813388.139681:0:22729:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788813388.139733:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875706313399680:12345-0@lo:38:kworker.0 Request processed in 74us (313us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788813388.139741:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788813388.139792:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a50e3f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813388.139798:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788813388.139802:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313399680:0@lo:38:kworker.0 00000100:00100000:1.0:1788813388.139955:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813388.139969:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313399552:0@lo:400:kworker.0 00000100:00100000:1.0:1788813388.140005:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813388.140058:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313399808 00000100:00100000:1.0:1788813388.140062:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313399808 00000100:00100000:1.0:1788813388.140086:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813388.140091:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313399808:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788813388.140111:0:22725:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:1.0:1788813388.140173:0:22725:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf32533d6ff704515 00000004:00100000:1.0:1788813388.140190:0:22725:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788813388.140328:0:22725:0:(import.c:65:import_set_state_nolock()) ffff948a61042000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813388.140377:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875706313399808:12345-0@lo:38:kworker.0 Request processed in 285us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813388.140384:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813388.145281:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313399552 00000100:00100000:2.0:1788813388.145299:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313399552 00000100:00100000:2.0:1788813388.145401:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813388.145412:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a4a623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+12:3627:x1875706313399552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813388.145618:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a4a623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+12:3627:x1875706313399552:12345-0@lo:400:kworker.0 Request processed in 207us (5610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813388.145625:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788813388.149372:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313399552:0@lo:400:kworker.0 00010000:00080000:2.0:1788813388.155500:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff948943125500 x1875706313399808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788813388.155533:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788813388.155543:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788813388.155548:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788813388.155552:0:3624:0:(import.c:65:import_set_state_nolock()) ffff94894344c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788813388.155558:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313399808:0@lo:38:kworker.0 00010000:00010000:2.0:1788813388.648102:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788813388.796304:0:23060:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788813388.796505:0:23060:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788813388.908554:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00010000:00010000:2.0:1788813389.683806:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813389.924017:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00000020:00000004:1.0:1788813390.040559:0:23110:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788813390.040759:0:23110:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788813390.692281:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813390.953400:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00010000:00010000:2.0:1788813391.716185:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813391.979114:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00000100:00100000:3.0:1788813392.232247:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813382/real 1788813382] req@ffff94894348b800 x1875706313396736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813392 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813392.232278:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94894348b800 x1875706313396736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813392 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813392.232289:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813382/real 1788813382] req@ffff94894348a300 x1875706313396608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813392 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813392.232300:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94894348a300 x1875706313396608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813392 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788813392.232318:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b57d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813392.232333:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788813392.232352:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313396736:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788813392.232359:0:3624:0:(import.c:65:import_set_state_nolock()) ffff9489437d8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813392.232364:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788813392.232367:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313396608:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788813392.233580:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1788813392.234424:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788813392.234431:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788813392.234435:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a50e3f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813392.234457:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 541 00000100:00080000:1.0:1788813392.234463:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788813392.234477:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948a50e3f800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813392.234522:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948943489180 x1875706313400064/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813392.234549:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813392.234553:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788813392.234555:0:36:0:(import.c:65:import_set_state_nolock()) ffff9489437d8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813392.234559:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 535 00000100:00080000:1.0:1788813392.234561:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788813392.234566:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9489437d8800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813392.234579:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948943489500 x1875706313400192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813392.234588:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813392.234600:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788813392.234602:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a7b57d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813392.234606:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 535 00000100:00080000:1.0:1788813392.234608:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788813392.234613:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948a7b57d800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813392.234626:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948943488e00 x1875706313400320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813392.236648:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313400064:0@lo:38:kworker.0 00000100:00100000:0.0:1788813392.236720:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813392.236769:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313400192:0@lo:8:kworker.0 00000400:00000100:0.0:1788813392.236802:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313400192 offset 0 length 520: 4 00000100:00100000:0.0:1788813392.236823:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313400320:0@lo:8:kworker.0 00000400:00000100:0.0:1788813392.236843:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313400320 offset 0 length 520: 4 00000100:00100000:0.0:1788813392.236873:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313400064 00000100:00100000:0.0:1788813392.236880:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313400064 00000100:00100000:0.0:1788813392.236924:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813392.236950:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875706313400064:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788813392.236970:0:22729:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788813392.237014:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875706313400064:12345-0@lo:38:kworker.0 Request processed in 82us (294us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788813392.237021:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788813392.237063:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a50e3f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788813392.237068:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788813392.237071:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313400064:0@lo:38:kworker.0 00000100:00100000:2.0:1788813392.238079:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313400448:0@lo:400:kworker.0 00000100:00100000:2.0:1788813392.238133:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813392.238171:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313399936:0@lo:400:kworker.0 00000100:00100000:2.0:1788813392.238197:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813392.238330:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313399936 00000100:00100000:0.0:1788813392.238336:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313399936 00000100:00100000:0.0:1788813392.238430:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788813392.238447:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a4a620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+12:3626:x1875706313399936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813392.238507:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a4a620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+12:3626:x1875706313399936:12345-0@lo:400:kworker.0 Request processed in 70us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813392.238514:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788813392.238805:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313399936:0@lo:400:kworker.0 00000100:00100000:3.0:1788813392.239665:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313400448 00000100:00100000:3.0:1788813392.239673:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313400448 00000100:00100000:3.0:1788813392.239737:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813392.239745:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313400448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813392.239825:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313400448:12345-0@lo:400:kworker.0 Request processed in 80us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813392.239831:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788813392.240097:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff948943488700 x1875706313400448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813392.240111:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313400448:0@lo:400:kworker.0 00010000:00010000:2.0:1788813392.745397:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813392.996441:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00010000:00010000:2.0:1788813393.766870:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813394.023983:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00000040:00080000:0.0:1788813394.149141:0:22759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788813394.788252:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813395.044166:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00010000:00010000:3.0:1788813395.819655:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813396.069698:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00010000:00010000:2.0:1788813396.837176:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813397.092068:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00000100:00080000:3.0:1788813397.348178:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788813397.348185:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788813397.348189:0:37:0:(import.c:65:import_set_state_nolock()) ffff948a50e3f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813397.348197:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 545 00000100:00080000:3.0:1788813397.348204:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788813397.348216:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948a50e3f800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813397.348246:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a6eda7480 x1875706313400704/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813397.348267:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813397.348271:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813397.348274:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813397.348277:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788813397.348341:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313400704:0@lo:38:kworker.0 00000100:00100000:3.0:1788813397.348575:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813397.348588:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313400576:0@lo:400:kworker.0 00000100:00100000:3.0:1788813397.348681:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313400704 00000100:00100000:3.0:1788813397.348693:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313400704 00000100:00100000:1.0:1788813397.348693:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813397.348769:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813397.348772:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813397.348782:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875706313400704:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788813397.348785:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313400832:0@lo:400:kworker.0 00010000:00020000:3.0:1788813397.348812:0:22729:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788813397.348838:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813397.348885:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875706313400704:12345-0@lo:38:kworker.0 Request processed in 103us (471us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813397.348894:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813397.348895:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313400576 00000100:00100000:1.0:1788813397.348904:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313400576 00000100:00080000:3.0:1788813397.348979:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a50e3f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813397.348985:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813397.348989:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313400704:0@lo:38:kworker.0 00000100:00100000:1.0:1788813397.350105:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788813397.350213:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+12:3627:x1875706313400576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813397.350777:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+12:3627:x1875706313400576:12345-0@lo:400:kworker.0 Request processed in 659us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813397.350788:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788813397.350853:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313400832 00000100:00100000:1.0:1788813397.350861:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313400832 00000100:00100000:1.0:1788813397.350904:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813397.350910:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313400832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813397.352656:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313400832:12345-0@lo:400:kworker.0 Request processed in 1733us (3808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813397.355824:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813397.358063:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313400576:0@lo:400:kworker.0 00010000:00080000:2.0:1788813397.358106:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff948a6eda4e00 x1875706313400832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813397.358119:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313400832:0@lo:400:kworker.0 00000020:01000004:3.0:1788813397.723388:0:23455:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788813397.723393:0:23455:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788813397.723395:0:23455:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788813397.723574:0:23455:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff948a6eab6800 00000020:01000004:3.0:1788813397.723591:0:23455:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788813397.723603:0:23455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788813397.723616:0:23455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff948a6adb19c0) 00000020:00000080:3.0:1788813397.723633:0:23455:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788813397.787112:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788813397.788514:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788813397.789340:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788813397.789928:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788813397.790331:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788813397.790542:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788813397.791187:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788813397.791390:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788813397.791617:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788813397.791852:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788813397.792249:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788813397.792449:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788813397.792668:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788813397.792916:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788813397.793230:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788813397.793461:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788813397.793686:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788813397.794086:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788813397.794306:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788813397.794515:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788813397.794723:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788813397.795045:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788813397.795272:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788813397.795450:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788813397.795669:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788813397.795913:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788813397.797485:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788813397.798223:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788813397.798768:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788813397.799131:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788813397.799552:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788813397.799802:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788813397.800115:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788813397.800335:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788813397.801455:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788813397.802210:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788813397.802510:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788813397.802732:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788813397.802995:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788813397.803284:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788813397.803514:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788813397.803794:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788813397.804126:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788813397.804409:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788813397.805644:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788813397.806099:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788813397.813589:0:23455:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788813397.815115:0:23455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788813397.815130:0:23455:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788813397.815144:0:23455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff704523 00000020:01000004:3.0:1788813397.815152:0:23455:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788813397.815174:0:23455:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788813397.815178:0:23455:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788813397.815184:0:23455:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788813397.815214:0:23455:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788813397.815218:0:23455:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.113@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788813397.826088:0:23455:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788813397.826133:0:23455:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.113@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788813397.826138:0:23455:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788813397.826140:0:23455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788813397.826142:0:23455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813397.826143:0:23455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813397.826144:0:23455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813397.826145:0:23455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813397.826146:0:23455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788813397.826148:0:23455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813397.826149:0:23455:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788813397.826153:0:23455:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788813397.826155:0:23455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788813397.826156:0:23455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788813397.826158:0:23455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813397.826159:0:23455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813397.826160:0:23455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813397.826161:0:23455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813397.826162:0:23455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788813397.826163:0:23455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813397.826164:0:23455:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788813397.826191:0:23455:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788813397.826214:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943127100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313400960:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788813397.826299:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813397.826344:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813397.826431:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313400960 00000100:00100000:3.0:1788813397.826440:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313400960 00000100:00100000:3.0:1788813397.826492:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788813397.826502:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+12:23455:x1875706313400960:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788813397.826542:0:22716:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788813397.826545:0:22716:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788813397.826553:0:22716:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788813397.828133:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+12:23455:x1875706313400960:12345-0@lo:253:mount.lustre.0 Request processed in 1625us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813397.828145:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788813397.829874:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943127100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313400960:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788813397.829893:0:23455:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788813397.829896:0:23455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788813397.829898:0:23455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788813397.829899:0:23455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813397.829901:0:23455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813397.829902:0:23455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813397.829903:0:23455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813397.829905:0:23455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788813397.829925:0:23455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813397.829926:0:23455:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788813397.830130:0:23455:0:(tgt_mount.c:101:server_register_mount()) register mount ffff948a6eab6800 from lustre-MDT0001 10000000:01000000:0.0:1788813397.830174:0:23455:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788813397.830177:0:23455:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788813397.830185:0:23455:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff948a6edbb380 local copy 00010000:00010000:0.0:1788813397.830196:0:23455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704420 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813397.830307:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813397.830363:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813397.830472:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe76600 going to sleep for 11 seconds 00000100:00100000:1.0:1788813397.830587:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313401088 00000100:00100000:1.0:1788813397.830595:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313401088 00000100:00100000:1.0:1788813397.830677:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788813397.830687:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+12:23455:x1875706313401088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813397.830796:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+12:23455:x1875706313401088:12345-0@lo:501:mount.lustre.0 Request processed in 111us (432us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813397.830805:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788813397.830878:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401088:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788813397.830891:0:23455:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788813397.830908:0:23455:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788813397.830914:0:23455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704420 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813397.830923:0:23455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704420 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813397.830989:0:23455:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff948a6eab6800 10000000:01000000:0.0:1788813397.830996:0:23455:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788813397.831002:0:23455:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff948a6edbb380 10000000:01000000:0.0:1788813397.831004:0:23455:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788813397.831008:0:23455:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff948a6edbb380 from 1 10000000:01000000:0.0:1788813397.831011:0:23455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788813397.831039:0:23455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff70452a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813397.831061:0:23455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff70452a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813397.831071:0:23455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff70452a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813397.831085:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813397.831109:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813397.831534:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe76600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813397.831593:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313401216 00000100:00100000:2.0:1788813397.831599:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313401216 00000100:00100000:2.0:1788813397.831625:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788813397.831632:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+12:23455:x1875706313401216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813397.831652:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813397.831665:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948941a81400/0xf32533d6ff704531 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70452a expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813397.831688:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948941a81400/0xf32533d6ff704531 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70452a expref: 13 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813397.831786:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948941a81400/0xf32533d6ff704531 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70452a expref: 13 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813397.831797:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948941a81400, rc 0) 00000100:00100000:2.0:1788813397.831841:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+13:23455:x1875706313401216:12345-0@lo:101:mount.lustre.0 Request processed in 209us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813397.831848:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788813397.831922:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813397.832059:0:23455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff70452a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704531 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813397.832068:0:23455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff70452a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff704531 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813397.832086:0:23455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788813397.832104:0:23455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff70452a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704531 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813397.832112:0:23455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff70452a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704531 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813397.832122:0:23455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff948a6eab6800 10000000:01000000:0.0:1788813397.832126:0:23455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788813397.832130:0:23455:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff948a6eab6800 from 1 10000000:01000000:0.0:1788813397.832132:0:23455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788813397.832159:0:23455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff704538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813397.832167:0:23455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff704538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813397.832174:0:23455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff704538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813397.832189:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813397.832216:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813397.832229:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe76600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813397.832277:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313401344 00000100:00100000:2.0:1788813397.832282:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313401344 00000100:00100000:2.0:1788813397.832303:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788813397.832311:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+13:23455:x1875706313401344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813397.832318:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813397.832327:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948941a80c00/0xf32533d6ff70453f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff704538 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813397.832340:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948941a80c00/0xf32533d6ff70453f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff704538 expref: 14 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813397.832348:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948941a80c00/0xf32533d6ff70453f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704538 expref: 14 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813397.832354:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948941a80c00, rc 0) 00000100:00100000:2.0:1788813397.832399:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+14:23455:x1875706313401344:12345-0@lo:101:mount.lustre.0 Request processed in 89us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813397.832405:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788813397.832815:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813397.832826:0:23455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff704538 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70453f expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813397.832833:0:23455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff704538 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70453f expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813397.832846:0:23455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788813397.832860:0:23455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff704538 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70453f expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813397.832867:0:23455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff704538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70453f expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813397.832873:0:23455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788813397.832877:0:23455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788813397.832881:0:23455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff948a6eab6800 10000000:01000000:0.0:1788813397.832891:0:23455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788813397.832895:0:23455:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788813397.832897:0:23455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788813397.832915:0:23455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166f600/0xf32533d6ff704546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813397.832921:0:23455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a4166f600/0xf32533d6ff704546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813397.833051:0:23455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a4166f600/0xf32533d6ff704546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813397.833068:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401472:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813397.833094:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813397.833124:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe76600 going to sleep for 11 seconds 00000100:00100000:1.0:1788813397.833174:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313401472 00000100:00100000:1.0:1788813397.833179:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313401472 00000100:00100000:1.0:1788813397.833214:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788813397.833220:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+14:23455:x1875706313401472:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813397.833228:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813397.833236:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff70454d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff704546 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813397.833249:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff70454d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff704546 expref: 15 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813397.833257:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff70454d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704546 expref: 15 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813397.833263:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8000, rc 0) 00000100:00100000:1.0:1788813397.833291:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+15:23455:x1875706313401472:12345-0@lo:101:mount.lustre.0 Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813397.833296:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788813397.833526:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401472:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813397.833537:0:23455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a4166f600/0xf32533d6ff704546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70454d expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813397.833546:0:23455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a4166f600/0xf32533d6ff704546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70454d expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813397.835088:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1788813397.837153:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813397.841873:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788813397.842616:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1788813397.842643:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1788813397.842659:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1788813397.842674:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1788813397.842688:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1788813397.842805:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1788813397.842820:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1788813397.842834:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1788813397.842846:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1788813397.842859:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1788813397.842872:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1788813397.842886:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1788813397.842899:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1788813397.842911:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1788813397.842926:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1788813397.843110:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1788813397.843123:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1788813397.843134:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1788813397.843146:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1788813397.843157:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1788813397.843168:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1788813397.843178:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1788813397.843194:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1788813397.843206:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1788813397.843217:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1788813397.843229:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1788813397.843242:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1788813397.843256:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1788813397.843269:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1788813397.843287:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1788813397.843301:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1788813397.843316:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1788813397.843330:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1788813397.843344:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1788813397.843358:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1788813397.843372:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1788813397.843386:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1788813397.843400:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1788813397.843428:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1788813397.843442:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1788813397.843457:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1788813397.843469:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1788813397.843480:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1788813397.843515:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1788813397.843521:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1788813397.843640:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813397.844124:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813397.844174:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe76c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813397.844258:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313401600 00000100:00100000:1.0:1788813397.844276:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313401600 00000100:00100000:1.0:1788813397.844337:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813397.844348:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+15:23455:x1875706313401600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813397.844520:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+15:23455:x1875706313401600:12345-0@lo:501:mount.lustre.0 Request processed in 173us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813397.844528:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788813397.844876:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813397.844922:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401728:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813397.845173:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813397.845212:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813397.845265:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313401728 00000100:00100000:0.0:1788813397.845270:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313401728 00000100:00100000:0.0:1788813397.845314:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788813397.845322:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+15:23455:x1875706313401728:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813397.848394:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+15:23455:x1875706313401728:12345-0@lo:503:mount.lustre.0 Request processed in 3061us (3209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813397.848419:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788813397.849276:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401728:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788813397.849846:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788813397.850050:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813397.850113:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813397.850144:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813397.850336:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313401856 00000100:00100000:0.0:1788813397.850343:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313401856 00000100:00100000:0.0:1788813397.850392:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788813397.850401:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+15:23455:x1875706313401856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813397.854242:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+15:23455:x1875706313401856:12345-0@lo:502:mount.lustre.0 Request processed in 3834us (4120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813397.854256:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788813397.855018:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788813397.855308:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788813397.855337:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1788813397.855348:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1788813397.855359:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1788813397.855370:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1788813397.855380:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1788813397.855391:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1788813397.855402:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1788813397.855422:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1788813397.855434:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1788813397.855445:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1788813397.855455:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1788813397.855466:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1788813397.855477:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1788813397.855498:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1788813397.855509:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1788813397.855519:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1788813397.855530:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1788813397.855541:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1788813397.855553:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1788813397.855564:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1788813397.855574:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1788813397.855584:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1788813397.855595:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1788813397.855605:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1788813397.855615:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1788813397.855626:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1788813397.855636:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1788813397.855646:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1788813397.855657:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1788813397.855667:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1788813397.855677:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1788813397.855688:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1788813397.855698:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1788813397.855708:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1788813397.855718:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1788813397.855729:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1788813397.855752:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1788813397.855765:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1788813397.855775:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1788813397.856003:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1788813397.856024:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1788813397.856035:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1788813397.856045:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1788813397.856091:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813397.856159:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813397.857168:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813397.857906:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313401984 00000100:00100000:0.0:1788813397.857917:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313401984 00000100:00100000:0.0:1788813397.857997:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788813397.858006:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+15:23455:x1875706313401984:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813397.858170:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+15:23455:x1875706313401984:12345-0@lo:502:mount.lustre.0 Request processed in 165us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813397.858178:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788813397.859161:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313401984:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788813397.859317:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1788813397.859332:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788813397.860668:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813397.860679:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813397.860681:0:23459:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788813397.860687:0:23459:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788813397.860690:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788813397.860787:0:23459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff948a779399c0) 00000020:00000080:0.0:1788813397.860811:0:23459:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788813397.860818:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788813397.860905:0:23459:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788813397.860914:0:23459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff70455b 00000020:00000080:2.0:1788813397.861254:0:23459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788813397.861260:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813397.861264:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813397.861266:0:23459:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788813397.861268:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813397.861271:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813397.861272:0:23459:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788813397.861275:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788813397.861283:0:23459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff948a44760000) 00000020:00000080:2.0:1788813397.861295:0:23459:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788813397.861299:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788813397.861301:0:23459:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788813397.861303:0:23459:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788813397.861309:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788813397.861383:0:23459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a6eab6800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788813397.861395:0:23459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff948a447619c0) 00000020:00000080:2.0:1788813397.861404:0:23459:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788813397.861475:0:23459:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788813397.861481:0:23459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff704570 00000020:00000080:2.0:1788813397.861807:0:23459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788813397.861815:0:23459:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788813397.861819:0:23459:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf32533d6ff704577 00080000:01000000:2.0:1788813397.861825:0:23459:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788813397.861828:0:23459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff70457e 00010000:00010000:3.0:1788813397.868161:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813397.984388:0:23459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788813397.986631:0:23459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788813397.987514:0:23459:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788813397.988633:0:23459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788813397.988645:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813397.988651:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813397.988653:0:23459:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788813397.988656:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813397.988662:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813397.988663:0:23459:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788813397.988666:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788813397.988672:0:23459:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:00000080:1.0:1788813397.988700:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813397.988715:0:23459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff948a506e4d40) 00000020:00000080:1.0:1788813397.988747:0:23459:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788813397.988753:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788813397.988826:0:23459:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788813397.988834:0:23459:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788813397.988841:0:23459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff70458c 00010000:00080000:1.0:1788813397.988873:0:23459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a7b56f000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813397.990508:0:23459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788813397.993413:0:23459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788813397.993589:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788813397.993627:0:23459:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788813397.993649:0:23459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff704593 00000100:00080000:1.0:1788813397.993660:0:23459:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813397.993672:0:23459:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff948a7b56f000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813397.993714:0:23459:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94894348aa00 x1875706313402112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788813397.993763:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313402112:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788813397.994161:0:23459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788813397.994215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788813397.994219:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:2.0:1788813397.994221:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1788813397.994222:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a50e3f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813397.994227:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 550 00000100:00080000:0.0:1788813397.994229:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1788813397.994233:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313402240:0@lo:400:kworker.0 00000100:00080000:0.0:1788813397.994235:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948a50e3f800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813397.994249:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489443b3800 x1875706313402368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813397.994265:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813397.994268:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813397.994273:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813397.994276:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788813397.994345:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813397.994350:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813397.994351:0:23459:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788813397.994355:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788813397.994358:0:23459:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788813397.994359:0:23459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788813397.994361:0:23459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788813397.994362:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788813397.994364:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813397.994366:0:23459:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788813397.994368:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813397.994372:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813397.994373:0:23459:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788813397.994376:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788813397.994415:0:23459:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788813397.994429:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813397.994432:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813397.994433:0:23459:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788813397.994435:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788813397.994436:0:23459:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788813397.994437:0:23459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788813397.994438:0:23459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788813397.994440:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788813397.994441:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813397.994442:0:23459:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788813397.994444:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788813397.994447:0:23459:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788813397.994449:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813397.994450:0:23459:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788813397.994452:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788813397.994456:0:23459:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:01000000:0.0:1788813397.994475:0:23459:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788813397.994477:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788813397.994493:0:23459:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff948a7b704d40) 00000020:00000080:0.0:1788813397.994505:0:23459:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788813397.994509:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788813397.994562:0:23459:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788813397.994568:0:23459:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788813397.994573:0:23459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff7045a1 00010000:00080000:0.0:1788813397.994597:0:23459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a74aa7800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.113@tcp at head 00010000:00010000:0.0:1788813397.994872:0:23459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788813397.995137:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813397.995148:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313402496:0@lo:400:kworker.0 00000100:00100000:1.0:1788813397.995294:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813397.995346:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313402368:0@lo:38:kworker.0 00000100:00100000:1.0:1788813397.995376:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813397.995421:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313402112 00000100:00100000:1.0:1788813397.995429:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313402112 00000100:00100000:1.0:1788813397.995451:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313402368 00000100:00100000:1.0:1788813397.995454:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313402368 00000100:00100000:2.0:1788813397.995457:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813397.995466:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813397.995472:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875706313402112:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788813397.995493:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313402240 00000100:00100000:2.0:1788813397.995497:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313402240 00010000:00080000:1.0:1788813397.995499:0:22729:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000100:00100000:2.0:1788813397.995529:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000020:00000080:1.0:1788813397.995529:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff7045a8 00000100:00100000:2.0:1788813397.995535:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+15:3626:x1875706313402240:12345-0@lo:400:kworker.0 00000004:00100000:1.0:1788813397.995542:0:22729:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788813397.995548:0:22729:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1788813397.995589:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+15:3626:x1875706313402240:12345-0@lo:400:kworker.0 Request processed in 53us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813397.995596:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788813397.995643:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313402240:0@lo:400:kworker.0 00000100:00100000:1.0:1788813397.995775:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813397.995881:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313402496 00000100:00100000:1.0:1788813397.995885:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313402496 00000100:00100000:1.0:1788813397.995913:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813397.995919:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313402496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813397.996191:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313402496:12345-0@lo:400:kworker.0 Request processed in 271us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813397.996197:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788813397.996415:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9489443b3b80 x1875706313402496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813397.996426:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313402496:0@lo:400:kworker.0 00000040:01000000:1.0:1788813397.996544:0:23459:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788813397.996826:0:23459:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788813397.998171:0:23459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813397.998418:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788813397.998545:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788813397.998806:0:23464:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788813397.998811:0:23464:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788813397.999289:0:23459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788813397.999300:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788813397.999337:0:23459:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788813397.999357:0:23459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff7045af 00000100:00080000:1.0:1788813397.999365:0:23459:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813397.999376:0:23459:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff948a74aa7800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813397.999409:0:23459:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948943488000 x1875706313402624/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813397.999438:0:23459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788813397.999486:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813397.999491:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813397.999493:0:23459:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788813397.999496:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788813397.999498:0:23459:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788813397.999501:0:23459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813397.999502:0:23459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813397.999503:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788813397.999506:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813397.999507:0:23459:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788813397.999510:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813397.999514:0:23459:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788813397.999517:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813397.999518:0:23459:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788813397.999522:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788813397.999525:0:23459:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:01000000:1.0:1788813397.999547:0:23459:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000100:00100000:2.0:1788813397.999549:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313402624:0@lo:8:llog_process_th.0 00000020:00000080:1.0:1788813397.999550:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813397.999565:0:23459:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff94894207cd40) 00000020:00000080:1.0:1788813397.999577:0:23459:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788813397.999582:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000400:00000100:2.0:1788813397.999595:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313402624 offset 0 length 520: 4 00000004:00080000:1.0:1788813397.999635:0:23459:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788813397.999641:0:23459:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788813397.999647:0:23459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff7045bd 00010000:00080000:1.0:1788813397.999673:0:23459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948941924000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813397.999891:0:23459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788813397.999979:0:23459:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788813397.999993:0:23459:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1788813398.000081:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813398.000086:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813398.000088:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813398.000091:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813398.000530:0:22729:0:(import.c:65:import_set_state_nolock()) ffff948a74aa0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813398.000768:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3624:x1875706313402112:12345-0@lo:38:llog_process_th.0 Request processed in 5293us (5472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813398.000780:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788813398.000803:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813398.000809:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875706313402368:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788813398.000849:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875706313402368:12345-0@lo:38:kworker.0 Request processed in 39us (5472us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788813398.000855:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813398.001223:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788813398.001234:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788813398.001242:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788813398.001247:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788813398.001250:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b56f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000040:00080000:1.0:1788813398.001275:0:23459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788813398.001300:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313402112:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788813398.001324:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788813398.001329:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a50e3f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813398.001333:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788813398.001336:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313402368:0@lo:38:kworker.0 00000040:00080000:1.0:1788813398.001482:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000100:00100000:2.0:1788813398.001526:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313402752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813398.001564:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788813398.001592:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000100:00100000:3.0:1788813398.001638:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313402752 00000100:00100000:3.0:1788813398.001645:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313402752 00000100:00100000:3.0:1788813398.001683:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813398.001690:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3627:x1875706313402752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788813398.001726:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788813398.001900:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3627:x1875706313402752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 209us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813398.001906:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:0.0:1788813398.002168:0:23466:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788813398.002173:0:23466:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1788813398.002545:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313402752:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1788813398.002586:0:23459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788813398.002596:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788813398.002626:0:23459:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788813398.002642:0:23459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff7045c4 00000100:00080000:1.0:1788813398.002648:0:23459:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813398.002655:0:23459:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff948941924000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813398.002674:0:23459:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948943489880 x1875706313402880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813398.002692:0:23459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788813398.002762:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813398.002767:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813398.002774:0:23459:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788813398.002778:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813398.002782:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813398.002783:0:23459:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788813398.002786:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788813398.002788:0:23459:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788813398.002791:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:0.0:1788813398.002791:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:1.0:1788813398.002793:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813398.002794:0:23459:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000100:00080000:0.0:1788813398.002795:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788813398.002796:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813398.002798:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:0.0:1788813398.002798:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:1.0:1788813398.002800:0:23459:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788813398.002803:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00080000:0.0:1788813398.002805:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788813398.002825:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813398.002828:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813398.002830:0:23459:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788813398.002833:0:23459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00100000:2.0:1788813398.002888:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313402880:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788813398.002925:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313402880 offset 0 length 520: 4 00000020:01000000:3.0:1788813398.002993:0:23455:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788813398.003019:0:23455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788813398.003039:0:23455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166f600/0xf32533d6ff704546 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70454d expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813398.003050:0:23455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4166f600/0xf32533d6ff704546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70454d expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813398.003058:0:23455:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a6eab6800 from 1 10000000:01000000:3.0:1788813398.003060:0:23455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788813398.003083:0:23455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4200/0xf32533d6ff7045cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813398.003095:0:23455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a821e4200/0xf32533d6ff7045cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813398.003105:0:23455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a821e4200/0xf32533d6ff7045cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813398.003118:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813398.003211:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813398.003239:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48e92480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813398.003248:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313403008 00000100:00100000:1.0:1788813398.003253:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313403008 00000100:00100000:1.0:1788813398.003291:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788813398.003300:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+15:23455:x1875706313403008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813398.003310:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813398.003324:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f9600/0xf32533d6ff7045d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7045cb expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.003344:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f9600/0xf32533d6ff7045d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7045cb expref: 16 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.003354:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f9600/0xf32533d6ff7045d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7045cb expref: 16 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.003363:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9600, rc 0) 00000100:00100000:1.0:1788813398.003401:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+16:23455:x1875706313403008:12345-0@lo:101:mount.lustre.0 Request processed in 103us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813398.003408:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788813398.003431:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813398.003445:0:23455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a821e4200/0xf32533d6ff7045cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7045d2 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813398.003455:0:23455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a821e4200/0xf32533d6ff7045cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7045d2 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813398.003963:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403136:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788813398.004005:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813398.004028:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313403136 00000100:00100000:2.0:1788813398.004033:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313403136 00000100:00100000:2.0:1788813398.004099:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788813398.004106:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+16:23455:x1875706313403136:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788813398.004118:0:22716:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788813398.004131:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788813398.004133:0:22716:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788813398.004182:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+16:23455:x1875706313403136:12345-0@lo:256:mount.lustre.0 Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813398.004187:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788813398.004251:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48e92480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813398.004262:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403136:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788813398.004686:0:23455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788813398.004728:0:23455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4200/0xf32533d6ff7045cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7045d2 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.004746:0:23455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a821e4200/0xf32533d6ff7045cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7045d2 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813398.004752:0:23455:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a6eab6800 from 1 10000000:01000000:2.0:1788813398.004754:0:23455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813398.004772:0:23455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a81600/0xf32533d6ff7045d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.004778:0:23455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948941a81600/0xf32533d6ff7045d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.004791:0:23455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948941a81600/0xf32533d6ff7045d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813398.004800:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788813398.004820:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813398.004836:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813398.004857:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313403264 00000100:00100000:1.0:1788813398.004862:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313403264 00000100:00100000:1.0:1788813398.004900:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788813398.004907:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+16:23455:x1875706313403264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813398.004916:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813398.004927:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7045e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7045d9 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.004961:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7045e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7045d9 expref: 17 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.004971:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7045e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7045d9 expref: 17 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.004983:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8200, rc 0) 00000100:00100000:1.0:1788813398.005023:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+17:23455:x1875706313403264:12345-0@lo:101:mount.lustre.0 Request processed in 116us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813398.005029:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788813398.005040:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813398.005052:0:23455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948941a81600/0xf32533d6ff7045d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7045e0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.005061:0:23455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948941a81600/0xf32533d6ff7045d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7045e0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813398.005815:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1788813398.006234:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813398.006367:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788813398.006384:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788813398.006391:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788813398.006408:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788813398.006416:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788813398.006422:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788813398.006429:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788813398.006436:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788813398.006443:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788813398.006450:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788813398.006456:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788813398.006466:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788813398.006468:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788813398.006515:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813398.006555:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813398.006588:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813398.006597:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313403392 00000100:00100000:0.0:1788813398.006603:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313403392 00000100:00100000:0.0:1788813398.006641:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788813398.006649:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+17:23455:x1875706313403392:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813398.006756:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+17:23455:x1875706313403392:12345-0@lo:501:mount.lustre.0 Request processed in 106us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813398.006764:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788813398.006809:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813398.006835:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813398.006866:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813398.006889:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813398.007016:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313403520 00000100:00100000:1.0:1788813398.007021:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313403520 00000100:00100000:1.0:1788813398.007072:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788813398.007079:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+17:23455:x1875706313403520:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813398.007155:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+17:23455:x1875706313403520:12345-0@lo:503:mount.lustre.0 Request processed in 78us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813398.007160:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788813398.007221:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403520:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788813398.007457:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788813398.007498:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813398.007524:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813398.007601:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48e92240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813398.007641:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313403648 00000100:00100000:2.0:1788813398.007646:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313403648 00000100:00100000:2.0:1788813398.007665:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788813398.007670:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+17:23455:x1875706313403648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813398.007761:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+17:23455:x1875706313403648:12345-0@lo:502:mount.lustre.0 Request processed in 90us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813398.007767:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813398.007810:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788813398.008030:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788813398.008055:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1788813398.008066:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1788813398.008077:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1788813398.008086:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1788813398.008096:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1788813398.008106:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1788813398.008116:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1788813398.008136:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788813398.008148:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1788813398.008159:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1788813398.008177:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813398.008207:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813398.008222:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48e92240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813398.008267:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313403776 00000100:00100000:2.0:1788813398.008270:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313403776 00000100:00100000:2.0:1788813398.008283:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788813398.008287:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+17:23455:x1875706313403776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813398.008341:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+17:23455:x1875706313403776:12345-0@lo:502:mount.lustre.0 Request processed in 53us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813398.008345:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788813398.008447:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788813398.008472:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1788813398.008477:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788813398.008907:0:23468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813398.008914:0:23468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813398.008916:0:23468:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788813398.008921:0:23468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a6eab6800 00000020:00000080:3.0:1788813398.008923:0:23468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788813398.008981:0:23468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813398.008985:0:23468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813398.008987:0:23468:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788813398.008990:0:23468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813398.008992:0:23468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813398.008994:0:23468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788813398.008997:0:23468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a6eab6800 00000020:00000080:3.0:1788813398.009000:0:23468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788813398.009048:0:23468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813398.009052:0:23468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813398.009059:0:23468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788813398.009063:0:23468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813398.009066:0:23468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813398.009067:0:23468:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788813398.009070:0:23468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a6eab6800 00000020:00000080:3.0:1788813398.009072:0:23468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788813398.009090:0:23468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813398.009092:0:23468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813398.009094:0:23468:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788813398.009096:0:23468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813398.009097:0:23468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813398.009098:0:23468:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788813398.009101:0:23468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a6eab6800 00000020:00000080:3.0:1788813398.009103:0:23468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788813398.009121:0:23468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813398.009124:0:23468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813398.009126:0:23468:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788813398.009128:0:23468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1788813398.009257:0:23455:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788813398.009281:0:23455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813398.009332:0:23455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a81600/0xf32533d6ff7045d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7045e0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.009344:0:23455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948941a81600/0xf32533d6ff7045d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7045e0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813398.009400:0:23455:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788813398.009403:0:23455:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff948a6eab6800 10000000:01000000:2.0:1788813398.009406:0:23455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff948a6eab6800 10000000:01000000:2.0:1788813398.009409:0:23455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788813398.009415:0:23455:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a6eab6800 from 1 10000000:01000000:2.0:1788813398.009417:0:23455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788813398.009444:0:23455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a81a00/0xf32533d6ff7045e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.009452:0:23455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948941a81a00/0xf32533d6ff7045e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.009461:0:23455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948941a81a00/0xf32533d6ff7045e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813398.009476:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943126d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788813398.009510:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813398.009545:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a488b6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813398.009593:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313403904 00000100:00100000:1.0:1788813398.009598:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313403904 00000100:00100000:1.0:1788813398.009665:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788813398.009672:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+17:23455:x1875706313403904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813398.009683:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813398.009694:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8800/0xf32533d6ff7045ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7045e7 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.009725:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8800/0xf32533d6ff7045ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7045e7 expref: 18 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.009751:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8800/0xf32533d6ff7045ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7045e7 expref: 18 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.009760:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8800, rc 0) 00000100:00100000:1.0:1788813398.009795:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+18:23455:x1875706313403904:12345-0@lo:101:mount.lustre.0 Request processed in 123us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813398.009801:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788813398.009960:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943126d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313403904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813398.009974:0:23455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948941a81a00/0xf32533d6ff7045e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7045ee expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.009983:0:23455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948941a81a00/0xf32533d6ff7045e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7045ee expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813398.013836:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1788813398.014123:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813398.014289:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788813398.014312:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1788813398.014325:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1788813398.014338:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1788813398.014349:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1788813398.014373:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1788813398.014385:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1788813398.014396:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1788813398.014407:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1788813398.014418:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1788813398.014429:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1788813398.014440:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1788813398.014451:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1788813398.014470:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1788813398.014480:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1788813398.014491:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1788813398.014502:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1788813398.014513:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1788813398.014525:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1788813398.014537:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1788813398.014550:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1788813398.014576:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1788813398.014590:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1788813398.014602:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1788813398.014615:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1788813398.014628:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1788813398.014639:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1788813398.014652:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1788813398.014663:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1788813398.014675:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1788813398.014687:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1788813398.014782:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1788813398.014805:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1788813398.014819:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1788813398.014832:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1788813398.014843:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1788813398.014855:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1788813398.014880:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1788813398.014896:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1788813398.014908:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1788813398.014921:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1788813398.014958:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1788813398.014974:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1788813398.014988:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1788813398.015001:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1788813398.015014:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1788813398.015039:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1788813398.015053:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1788813398.015152:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1788813398.015173:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1788813398.015192:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1788813398.015198:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1788813398.015281:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313404032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813398.015352:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813398.015403:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45838cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813398.016002:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313404032 00000100:00100000:0.0:1788813398.016012:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313404032 00000100:00100000:0.0:1788813398.016066:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788813398.016077:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+18:23455:x1875706313404032:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813398.016200:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+18:23455:x1875706313404032:12345-0@lo:501:mount.lustre.0 Request processed in 126us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813398.016208:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788813398.016230:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313404032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813398.016268:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313404160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813398.016306:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813398.016327:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45838cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813398.022550:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313404160 00000100:00100000:3.0:1788813398.022565:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313404160 00000100:00100000:3.0:1788813398.022627:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813398.022638:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+18:23455:x1875706313404160:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813398.022891:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+18:23455:x1875706313404160:12345-0@lo:503:mount.lustre.0 Request processed in 254us (6583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813398.022900:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788813398.023119:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313404160:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788813398.023663:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813398.023844:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313404288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813398.023894:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813398.024006:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a464156c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813398.024048:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313404288 00000100:00100000:3.0:1788813398.024053:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313404288 00000100:00100000:3.0:1788813398.024123:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788813398.024132:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+18:23455:x1875706313404288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813398.024221:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+18:23455:x1875706313404288:12345-0@lo:502:mount.lustre.0 Request processed in 89us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813398.024228:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788813398.024306:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313404288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813398.024473:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1788813398.024498:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1788813398.024511:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1788813398.024525:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1788813398.024546:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1788813398.024559:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1788813398.024571:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1788813398.024584:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1788813398.024596:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1788813398.024607:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1788813398.024619:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1788813398.024631:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1788813398.024656:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1788813398.024671:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1788813398.024683:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1788813398.024695:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1788813398.024722:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1788813398.024745:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1788813398.024761:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1788813398.024774:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1788813398.024787:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1788813398.024799:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1788813398.024811:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1788813398.024824:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1788813398.024838:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1788813398.024851:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1788813398.024863:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1788813398.024876:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1788813398.024900:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1788813398.024914:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1788813398.024927:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1788813398.024969:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1788813398.024984:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1788813398.024997:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1788813398.025009:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1788813398.025023:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1788813398.025034:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1788813398.025054:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1788813398.025067:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1788813398.025080:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1788813398.025091:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1788813398.025103:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1788813398.025114:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1788813398.025127:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1788813398.025150:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1788813398.025164:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1788813398.025175:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1788813398.025188:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1788813398.025227:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313404416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813398.025273:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813398.025303:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a464156c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813398.025631:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313404416 00000100:00100000:3.0:1788813398.025637:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313404416 00000100:00100000:3.0:1788813398.025783:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788813398.025792:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+18:23455:x1875706313404416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813398.025904:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+18:23455:x1875706313404416:12345-0@lo:502:mount.lustre.0 Request processed in 113us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813398.025912:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788813398.026044:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313404416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788813398.026193:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788813398.026221:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788813398.026244:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943126d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313404544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813398.026279:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813398.026418:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a488b6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813398.026516:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313404544 00000100:00100000:0.0:1788813398.026521:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313404544 00000100:00100000:0.0:1788813398.026545:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788813398.026552:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+18:23455:x1875706313404544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813398.026713:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+18:23455:x1875706313404544:12345-0@lo:502:mount.lustre.0 Request processed in 161us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813398.026720:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788813398.026845:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943126d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313404544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788813398.026885:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1788813398.026894:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788813398.028314:0:23473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788813398.028330:0:23473:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff948a7b700000) 00000020:00000080:0.0:1788813398.028352:0:23473:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788813398.028531:0:23473:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a6eab6800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788813398.028536:0:23473:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a6eab6800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788813398.028539:0:23473:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a6eab6800 3 00010000:00080000:0.0:1788813398.028569:0:23473:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a6e9ef800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.113@tcp at head 00010000:00010000:0.0:1788813398.031214:0:23473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788813398.031394:0:23473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788813398.031436:0:23473:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788813398.031915:0:23473:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf32533d6ff7045fc 00000100:00080000:0.0:1788813398.031929:0:23473:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788813398.031960:0:23473:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff948a6e9ef800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813398.031998:0:23473:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489443b3100 x1875706313404672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813398.032038:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875706313404672:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788813398.032103:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788813398.032158:0:23473:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788813398.032181:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813398.032185:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813398.032188:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813398.032191:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788813398.032530:0:23473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1788813398.032640:0:23455:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788813398.032674:0:23455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788813398.032695:0:23455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a81a00/0xf32533d6ff7045e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7045ee expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.032715:0:23455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948941a81a00/0xf32533d6ff7045e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7045ee expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788813398.032770:0:23455:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788813398.032772:0:23455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788813398.032774:0:23455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813398.032776:0:23455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813398.032777:0:23455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813398.032779:0:23455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813398.032780:0:23455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788813398.032782:0:23455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813398.032783:0:23455:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813398.032787:0:23455:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788813398.032789:0:23455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788813398.032790:0:23455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788813398.032791:0:23455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813398.032792:0:23455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813398.032794:0:23455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813398.032795:0:23455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813398.032796:0:23455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788813398.032797:0:23455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813398.032798:0:23455:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813398.032818:0:23455:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788813398.032831:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943126d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313404800:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788813398.032869:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813398.032887:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a488b6900 going to sleep for 11 seconds 00000100:00100000:2.0:1788813398.032907:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313404800 00000100:00100000:2.0:1788813398.032914:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313404800 00000100:00100000:2.0:1788813398.032978:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788813398.032987:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a75579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+18:23455:x1875706313404800:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788813398.033011:0:22718:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788813398.033024:0:22718:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788813398.033142:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313404672 00000100:00100000:1.0:1788813398.033147:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313404672 00000100:00100000:1.0:1788813398.033170:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813398.033176:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1875706313404672:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788813398.033194:0:22723:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:1.0:1788813398.033224:0:22723:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf32533d6ff704603 00000004:00100000:1.0:1788813398.033237:0:22723:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788813398.033268:0:22723:0:(import.c:65:import_set_state_nolock()) ffff948a60187800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813398.033330:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875706313404672:12345-0@lo:38:llog_process_th.0 Request processed in 152us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813398.033345:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788813398.033573:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9489443b3100 x1875706313404672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813398.033583:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788813398.033589:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788813398.033595:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788813398.033600:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788813398.033602:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a6e9ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788813398.033608:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875706313404672:0@lo:38:llog_process_th.0 00000001:00100000:1.0:1788813398.037159:0:22703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788813398.038510:0:22718:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788813398.038560:0:22718:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788813398.038871:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a75579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+18:23455:x1875706313404800:12345-0@lo:253:mount.lustre.0 Request processed in 5881us (5996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813398.038885:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788813398.039000:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943126d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:23455:1875706313404800:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788813398.039014:0:23455:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788813398.039017:0:23455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788813398.039019:0:23455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788813398.039021:0:23455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813398.039022:0:23455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813398.039023:0:23455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813398.039024:0:23455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813398.039026:0:23455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788813398.039027:0:23455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813398.039029:0:23455:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788813398.039042:0:23455:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788813398.040175:0:22739:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788813398.040181:0:22739:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788813398.040204:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70460a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813398.040219:0:22739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a821e4c00/0xf32533d6ff70450e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704507 expref: 17 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813398.040224:0:22739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f9600/0xf32533d6ff7045d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7045cb expref: 17 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813398.040229:0:22739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70460a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813398.040266:0:22739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f9600/0xf32533d6ff7045d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7045cb expref: 17 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813398.040276:0:22739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a7b5f9600/0xf32533d6ff7045d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7045cb expref: 17 pid: 22718 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813398.040287:0:22739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22739:1875706313404928:0@lo:104: 00000100:00100000:0.0:1788813398.040326:0:22739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813398.040364:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313404928 00010000:00010000:0.0:1788813398.040365:0:22739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a821e4c00/0xf32533d6ff70450e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff704507 expref: 17 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813398.040371:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313404928 00010000:00010000:0.0:1788813398.040372:0:22739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a821e4c00/0xf32533d6ff70450e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff704507 expref: 17 pid: 22717 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813398.040379:0:22739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22739:1875706313405056:0@lo:104: 00000100:00100000:0.0:1788813398.040399:0:22739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813398.040415:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313405056 00000100:00100000:0.0:1788813398.040416:0:22739:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45838cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813398.040418:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313405056 00000100:00100000:2.0:1788813398.040433:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813398.040441:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+4:22739:x1875706313404928:12345-0@lo:104: 00010000:00010000:2.0:1788813398.040456:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a821e4200/0xf32533d6ff7045cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7045d2 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.040519:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788813398.040531:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+4:22739:x1875706313404928:12345-0@lo:104: Request processed in 91us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813398.040537:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813398.040554:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813398.040560:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+3:22739:x1875706313405056:12345-0@lo:104: 00010000:00010000:2.0:1788813398.040567:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff704507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70450e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.040571:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813398.040578:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a821e4200/0xf32533d6ff7045cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7045d2 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.040585:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4200 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813398.040589:0:22712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a821e4200/0xf32533d6ff7045cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7045d2 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.040597:0:22712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a821e4200/0xf32533d6ff7045cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7045d2 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.040599:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788813398.040604:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+3:22739:x1875706313405056:12345-0@lo:104: Request processed in 45us (204us total) trans 0 rc 0/0 10000000:00010000:1.0:1788813398.040606:0:22712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a821e4200/0xf32533d6ff7045cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7045d2 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813398.040610:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:1.0:1788813398.040611:0:22712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788813398.040623:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813398.040639:0:22712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a821e4200/0xf32533d6ff7045cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7045d2 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.040655:0:22712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813398.040676:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a821e4200/0xf32533d6ff7045cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7045d2 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.040683:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a821e4200/0xf32533d6ff7045cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7045d2 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813398.040684:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813398.040693:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313405184:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813398.040695:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813398.040707:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813398.040709:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813398.040720:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813398.040770:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313405184 00000100:00100000:2.0:1788813398.040775:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313405184 00010000:00010000:1.0:1788813398.040778:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813398.040783:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff704507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70450e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.040789:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a80600 already unused, calling callback (ffffffffc13c1c20) 00010000:00010000:2.0:1788813398.040790:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f9600/0xf32533d6ff7045d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7045cb expref: 18 pid: 22718 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813398.040792:0:22711:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff704507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff70450e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.040800:0:22711:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff704507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff70450e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813398.040806:0:22711:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff704507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff70450e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813398.040810:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 10000000:01000000:1.0:1788813398.040812:0:22711:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788813398.040815:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:151fd599-5695-4163-8caa-7faa559323aa+18:3627:x1875706313405184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813398.040825:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813398.040827:0:22711:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff704507 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70450e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.040829:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f9600/0xf32533d6ff7045d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7045cb expref: 18 pid: 22718 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.040833:0:22711:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813398.040839:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f9600/0xf32533d6ff7045d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7045cb expref: 18 pid: 22718 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.040851:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff704507 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70450e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.040856:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813398.040857:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff704507 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70450e expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813398.040869:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813398.040870:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813398.040872:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813398.040880:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:151fd599-5695-4163-8caa-7faa559323aa+18:3627:x1875706313405184:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1788813398.040880:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813398.040882:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813398.040887:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813398.040907:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813398.040914:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313405312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813398.040964:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813398.040994:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313405312 00000100:00100000:2.0:1788813398.040997:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313405312 00010000:00010000:2.0:1788813398.041011:0:22710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a821e4c00/0xf32533d6ff70450e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff704507 expref: 18 pid: 22717 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813398.041028:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813398.041032:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:151fd599-5695-4163-8caa-7faa559323aa+18:3626:x1875706313405312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813398.041038:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813398.041042:0:22710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a821e4c00/0xf32533d6ff70450e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff704507 expref: 18 pid: 22717 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.041049:0:22710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a821e4c00/0xf32533d6ff70450e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff704507 expref: 18 pid: 22717 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.041060:0:22710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70460a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.041067:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70460a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788813398.041079:0:22710:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004833932s 00010000:00010000:2.0:1788813398.041088:0:22710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70460a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.041095:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70460a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.041102:0:22710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70460a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.041108:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70460a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.041113:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166ec00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813398.041117:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70460a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.041124:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70460a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.041133:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70460a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813398.041142:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813398.041174:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f9600/0xf32533d6ff7045d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7045cb expref: 18 pid: 22718 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813398.041179:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:151fd599-5695-4163-8caa-7faa559323aa+18:3626:x1875706313405312:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813398.041184:0:22739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22739:1875706313404928:0@lo:104: 00000100:00100000:2.0:1788813398.041186:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788813398.041195:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e4c00/0xf32533d6ff70450e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff704507 expref: 16 pid: 22717 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813398.041203:0:22739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22739:1875706313405056:0@lo:104: 00000100:00100000:2.0:1788813398.041207:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313405312:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813398.041219:0:22739:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70460a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813398.041222:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313405184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813398.041238:0:22739:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70460a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813398.041245:0:22739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70460a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813398.041251:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70460a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1788813398.042534:0:23455:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788813398.042539:0:23480:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788813398.042543:0:23480:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788813398.042881:0:23481:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788813398.043229:0:23455:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1788813398.043757:0:23481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813398.045375:0:23481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788813398.045430:0:23481:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1788813398.046665:0:23482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23482:1875706313405440:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788813398.046727:0:23482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813398.046781:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313405440 00000100:00100000:0.0:1788813398.046788:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313405440 00000100:00100000:0.0:1788813398.046829:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788813398.046835:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23482:x1875706313405440:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788813398.046894:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23482:x1875706313405440:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 59us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813398.046900:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788813398.046919:0:23482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a464156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813398.046957:0:23482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23482:1875706313405440:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788813398.046979:0:23482:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788813398.046998:0:23482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23482:1875706313405568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788813398.047020:0:23482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813398.047032:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313405568 00000100:00100000:0.0:1788813398.047034:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313405568 00000100:00100000:0.0:1788813398.047046:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788813398.047056:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23482:x1875706313405568:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788813398.047124:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23482:x1875706313405568:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 68us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813398.047128:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788813398.047139:0:23482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a3900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813398.047147:0:23482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23482:1875706313405568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788813398.047182:0:23482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23482:1875706313405696:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788813398.047198:0:23482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813398.047207:0:23482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a3cc0 going to sleep for 11 seconds 00000040:01000000:2.0:1788813398.047343:0:23455:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788813398.047376:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788813398.047704:0:23455:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788813398.047709:0:23455:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788813398.047757:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813398.048469:0:23455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788813398.048894:0:23455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788813398.048919:0:23455:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788813398.049050:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788813398.049553:0:23455:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:3.0:1788813398.050574:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313405696 00000100:00100000:3.0:1788813398.050584:0:22734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313405696 00000100:00100000:3.0:1788813398.050662:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813398.050671:0:22734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23482:x1875706313405696:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788813398.050848:0:22734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23482:x1875706313405696:12345-0@lo:900:lod0001_rec0000.0 Request processed in 176us (3646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813398.050856:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788813398.050921:0:23482:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9489443b1880 x1875706313405696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788813414 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813398.051083:0:23482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23482:1875706313405696:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788813398.051634:0:23482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23482:1875706313405824:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788813398.051676:0:23482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813398.051770:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313405824 00000100:00100000:1.0:1788813398.051776:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313405824 00000100:00100000:0.0:1788813398.051794:0:23482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a3900 going to sleep for 11 seconds 00000100:00100000:1.0:1788813398.051820:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813398.051828:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23482:x1875706313405824:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788813398.051903:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23482:x1875706313405824:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 76us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813398.051910:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788813398.052093:0:23482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23482:1875706313405824:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788813398.052141:0:23482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:3.0:1788813398.052390:0:23455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788813398.054090:0:23455:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788813398.054122:0:23455:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb265015bf988 00100000:10000000:3.0:1788813398.054129:0:23455:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:0.0:1788813398.054267:0:23482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788813398.054319:0:23482:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788813398.054324:0:23482:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:01000004:2.0:1788813398.054837:0:23455:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788813398.054861:0:23455:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788813398.054878:0:23455:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788813398.054907:0:23455:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788813398.060707:0:23455:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788813398.060925:0:23455:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788813398.119165:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00010000:00010000:2.0:1788813398.886263:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813399.081356:0:23477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788813399.140871:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 10000000:01000000:1.0:1788813399.461001:0:22720:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788813399.461009:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a6eab6800 from 12 10000000:01000000:1.0:1788813399.461015:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788813399.461067:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9c00/0xf32533d6ff704611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813399.461080:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9c00/0xf32533d6ff704611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813399.461092:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9c00/0xf32533d6ff704611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813399.461118:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313405952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813399.461193:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813399.461240:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ec02840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813399.461380:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313405952 00000100:00100000:0.0:1788813399.461389:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313405952 00000100:00100000:0.0:1788813399.461447:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813399.461456:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a75579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+16:22720:x1875706313405952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813399.461468:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813399.461480:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a4166fa00/0xf32533d6ff704618 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff704611 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813399.461501:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a4166fa00/0xf32533d6ff704618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff704611 expref: 17 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813399.461511:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a4166fa00/0xf32533d6ff704618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704611 expref: 17 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813399.461519:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166fa00, rc 0) 00000100:00100000:0.0:1788813399.461556:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a75579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+17:22720:x1875706313405952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813399.461572:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813399.461611:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313405952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813399.461623:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9c00/0xf32533d6ff704611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704618 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813399.461632:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9c00/0xf32533d6ff704611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff704618 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813399.461675:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313406080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788813399.461713:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813399.461742:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813399.461759:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313406080 00000100:00100000:0.0:1788813399.461762:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313406080 00000100:00100000:0.0:1788813399.461782:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788813399.461788:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7557a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+17:22720:x1875706313406080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788813399.461800:0:22718:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788813399.461814:0:22718:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788813399.461817:0:22718:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788813399.461883:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7557a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+17:22720:x1875706313406080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813399.461890:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788813399.461915:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313406080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788813399.461970:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788813399.461976:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9c00/0xf32533d6ff704611 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704618 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813399.461984:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9c00/0xf32533d6ff704611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704618 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813399.461993:0:22720:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788813399.461994:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9489430d0800 from 12 10000000:01000000:0.0:1788813399.461996:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788813399.462010:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166e800/0xf32533d6ff70461f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813399.462017:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a4166e800/0xf32533d6ff70461f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813399.462025:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a4166e800/0xf32533d6ff70461f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813399.462044:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313406208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813399.462064:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813399.462075:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813399.462084:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313406208 00000100:00100000:0.0:1788813399.462087:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313406208 00000100:00100000:0.0:1788813399.462104:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788813399.462108:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a75578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+17:22720:x1875706313406208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813399.462114:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813399.462121:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a4166ec00/0xf32533d6ff704626 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70461f expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813399.462133:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a4166ec00/0xf32533d6ff704626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70461f expref: 18 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813399.462141:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a4166ec00/0xf32533d6ff704626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70461f expref: 18 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813399.462147:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166ec00, rc 0) 00000100:00100000:0.0:1788813399.462168:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a75578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+18:22720:x1875706313406208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 59us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813399.462173:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788813399.462196:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313406208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813399.462204:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a4166e800/0xf32533d6ff70461f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704626 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813399.462212:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a4166e800/0xf32533d6ff70461f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff704626 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813399.462631:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313406336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788813399.462657:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813399.462732:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7fe9e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813399.466404:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313406336 00000100:00100000:1.0:1788813399.466493:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313406336 00000100:00100000:1.0:1788813399.466619:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788813399.466629:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7557a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+18:22720:x1875706313406336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788813399.466655:0:22718:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788813399.466677:0:22718:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788813399.466680:0:22718:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788813399.466844:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7557a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+18:22720:x1875706313406336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 217us (4186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813399.466853:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788813399.466964:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313406336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788813399.467021:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788813399.467030:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166e800/0xf32533d6ff70461f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704626 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813399.467041:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4166e800/0xf32533d6ff70461f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704626 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813399.909158:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813400.105151:0:23477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788813400.177315:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00010000:00010000:2.0:1788813400.945792:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813401.193403:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00010000:00010000:2.0:1788813401.956171:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813402.212087:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00000001:02000400:1.0:1788813402.769632:0:23725:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788813402.982447:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813403.236042:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 0 seconds 00000100:00080000:1.0:1788813403.493045:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788813403.493055:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788813403.493058:0:37:0:(import.c:65:import_set_state_nolock()) ffff948a50e3f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813403.493077:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948a50e3f800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813403.493109:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948943488380 x1875706313406592/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813403.493128:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813403.493131:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813403.493134:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813403.493137:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813403.493185:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813403.493188:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813403.493191:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813403.493194:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788813403.493391:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313406976:0@lo:400:kworker.0 00000100:00100000:1.0:1788813403.493473:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813403.493548:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813403.493555:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:151fd599-5695-4163-8caa-7faa559323aa:3625:1875706313406464:0@lo:400:kworker.0 00000100:00100000:1.0:1788813403.493585:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813403.493621:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313406592:0@lo:38:kworker.0 00000100:00100000:1.0:1788813403.493648:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813403.493675:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313406720:0@lo:400:kworker.0 00000100:00100000:1.0:1788813403.493708:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813403.493726:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813403.493731:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313406848:0@lo:400:kworker.0 00000100:00100000:1.0:1788813403.493750:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813403.493781:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313406976 00000100:00100000:1.0:1788813403.493789:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313406976 00000100:00100000:1.0:1788813403.493833:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313406720 00000100:00100000:1.0:1788813403.493837:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313406720 00000100:00100000:1.0:1788813403.493854:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813403.493914:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313406976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813403.494026:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313406976:12345-0@lo:400:kworker.0 Request processed in 165us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813403.494034:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813403.494063:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813403.494069:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313406720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813403.494102:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313406720:12345-0@lo:400:kworker.0 Request processed in 34us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813403.494107:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813403.494126:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313406464 00000100:00100000:1.0:1788813403.494130:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313406464 00000100:00100000:1.0:1788813403.494155:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788813403.494163:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a75579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+18:3625:x1875706313406464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813403.494190:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a75579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+18:3625:x1875706313406464:12345-0@lo:400:kworker.0 Request processed in 29us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813403.494195:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788813403.494218:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313406592 00000100:00100000:1.0:1788813403.494221:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313406592 00000100:00100000:1.0:1788813403.494232:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313406848 00000100:00100000:1.0:1788813403.494234:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313406848 00000100:00100000:1.0:1788813403.494247:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813403.494252:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875706313406592:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788813403.494274:0:22729:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:1.0:1788813403.494313:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff70462d 00000004:00100000:1.0:1788813403.494330:0:22729:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788813403.494337:0:22729:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:1.0:1788813403.494461:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948943488a80 x1875706313406720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813403.494477:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313406720:0@lo:400:kworker.0 00000100:00100000:1.0:1788813403.494509:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:151fd599-5695-4163-8caa-7faa559323aa:3625:1875706313406464:0@lo:400:kworker.0 00010000:00080000:1.0:1788813403.494528:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94894348aa00 x1875706313406976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813403.494537:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313406976:0@lo:400:kworker.0 00000100:00100000:0.0:1788813403.502836:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813403.502869:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313407104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813403.502948:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813403.502998:0:22728:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788813403.503007:0:22728:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788813403.503108:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313407104 00000100:00100000:0.0:1788813403.503116:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313407104 00000100:00100000:0.0:1788813403.503244:0:23758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788813403.503254:0:23758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3627:x1875706313406848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813403.503313:0:23758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3627:x1875706313406848:12345-0@lo:400:kworker.0 Request processed in 61us (9561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813403.503319:0:23758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788813403.503337:0:23758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813403.503344:0:23758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313407104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788813403.503368:0:23758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788813403.503403:0:23758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313407104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813403.503409:0:23758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813403.503451:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313407104:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788813403.503894:0:22729:0:(import.c:65:import_set_state_nolock()) ffff948a507c4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813403.503951:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1875706313406592:12345-0@lo:38:kworker.0 Request processed in 9698us (10302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813403.503959:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788813403.503996:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788813403.504005:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788813403.504011:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788813403.504013:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a50e3f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788813403.504034:0:3624:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000012b365cc): req@ffff948943125f80 x1875706313399168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813403.504052:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313406592:0@lo:38:kworker.0 00000100:00100000:3.0:1788813403.504103:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813403.504123:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42454000 going to sleep for 11 seconds 00000100:00100000:3.0:1788813403.504137:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313399168 00000100:00100000:3.0:1788813403.504141:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313399168 00000100:00100000:3.0:1788813403.504168:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788813403.504174:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22765:x1875706313399168:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788813403.504236:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22765:x1875706313399168:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 62us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813403.504241:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788813403.504267:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943125f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22765:1875706313399168:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788813403.504300:0:22765:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788813403.504337:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda7480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22765:1875706313407232:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788813403.504363:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813403.504380:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813403.504398:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313407232 00000100:00100000:3.0:1788813403.504403:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313407232 00000100:00100000:3.0:1788813403.504419:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813403.504425:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22765:x1875706313407232:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788813403.504499:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22765:x1875706313407232:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 74us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813403.504504:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813403.504521:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda7480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22765:1875706313407232:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788813403.504567:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda7480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22765:1875706313407360:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788813403.504582:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813403.504592:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813403.504600:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313407360 00000100:00100000:3.0:1788813403.504602:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313407360 00000100:00100000:3.0:1788813403.504614:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788813403.504617:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22765:x1875706313407360:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788813403.504650:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22765:x1875706313407360:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 31us (66us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813403.504656:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788813403.504680:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda7480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22765:1875706313407360:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788813403.504731:0:22765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813403.505628:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313406848:0@lo:400:kworker.0 00000100:00100000:1.0:1788813403.506333:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813403.506346:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313407488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813403.506393:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788813403.506423:0:22765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788813403.506475:0:22765:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:3.0:1788813403.506479:0:22765:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:3.0:1788813403.506566:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313407488 00000100:00100000:3.0:1788813403.506571:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313407488 00000100:00100000:3.0:1788813403.506609:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788813403.506615:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313407488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788813403.506652:0:22729:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788813403.509037:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313407488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2409us (2632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813403.509052:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788813403.509113:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313407488:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788813403.893272:0:23778:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788813403.893742:0:23778:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788813404.007011:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813404.388648:0:22759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1788813404.915741:0:23828:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813404.916168:0:23828:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788813405.030308:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813406.052121:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788813406.197105:0:23876:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda0f15cc0 20000000:00000080:1.0:1788813406.197125:0:23876:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff948a5e684000 uarg=0000000000000000 20000000:01000000:1.0:1788813406.197168:0:23876:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788813406.197175:0:23876:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788813406.197180:0:23876:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788813406.203597:0:23877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788813406.203753:0:23876:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788813406.213237:0:23876:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788813406.213269:0:23876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff704634 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.213290:0:23876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a821e5400/0xf32533d6ff7044dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7044d6 expref: 17 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.213299:0:23876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7045e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7045d9 expref: 17 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.213323:0:23876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff704634 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813406.217845:0:23876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7045e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7045d9 expref: 17 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813406.217870:0:23876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7045e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7045d9 expref: 17 pid: 22718 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813406.217887:0:23876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23876:1875706313407616:0@lo:104: 00000100:00100000:0.0:1788813406.218068:0:23876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813406.218132:0:23876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a821e5400/0xf32533d6ff7044dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7044d6 expref: 17 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813406.218140:0:23876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a821e5400/0xf32533d6ff7044dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7044d6 expref: 17 pid: 22718 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813406.218149:0:23876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23876:1875706313407744:0@lo:104: 00000100:00100000:0.0:1788813406.218171:0:23876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813406.219912:0:23876:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ec029c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813406.223843:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313407616 00000100:00100000:1.0:1788813406.223863:0:22707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313407616 00000100:00100000:0.0:1788813406.226541:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313407744 00000100:00100000:0.0:1788813406.226555:0:22707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313407744 00000100:00100000:0.0:1788813406.226578:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813406.226588:0:22707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:151fd599-5695-4163-8caa-7faa559323aa+4:23876:x1875706313407616:12345-0@lo:104: 00010000:00010000:0.0:1788813406.226606:0:22707:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948941a81600/0xf32533d6ff7045d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7045e0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813406.226859:0:22707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788813406.226868:0:22707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:151fd599-5695-4163-8caa-7faa559323aa+4:23876:x1875706313407616:12345-0@lo:104: Request processed in 280us (8798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813406.226876:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788813406.226896:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813406.226906:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948941a81600/0xf32533d6ff7045d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7045e0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813406.226913:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788813406.226922:0:22707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:151fd599-5695-4163-8caa-7faa559323aa+3:23876:x1875706313407744:12345-0@lo:104: 00010000:00010000:2.0:1788813406.226956:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a81600 already unused, calling callback (ffffffffc13c1c20) 00010000:00010000:0.0:1788813406.226962:0:22707:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a4166f400/0xf32533d6ff7044d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7044dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813406.226963:0:23478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948941a81600/0xf32533d6ff7045d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7045e0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.226984:0:23478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948941a81600/0xf32533d6ff7045d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7045e0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813406.226993:0:23478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948941a81600/0xf32533d6ff7045d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7045e0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813406.226998:0:23478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788813406.227008:0:22707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788813406.227015:0:22707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:151fd599-5695-4163-8caa-7faa559323aa+3:23876:x1875706313407744:12345-0@lo:104: Request processed in 93us (8842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813406.227021:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788813406.227037:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813406.227040:0:23478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948941a81600/0xf32533d6ff7045d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7045e0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813406.227043:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a4166f400/0xf32533d6ff7044d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7044dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227056:0:23478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813406.227060:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f400 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813406.227066:0:22712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a4166f400/0xf32533d6ff7044d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7044dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813406.227074:0:22712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4166f400/0xf32533d6ff7044d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7044dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813406.227081:0:22712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4166f400/0xf32533d6ff7044d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7044dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227083:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948941a81600/0xf32533d6ff7045d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7045e0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813406.227093:0:22712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788813406.227097:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948941a81600/0xf32533d6ff7045d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7045e0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813406.227111:0:22712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a4166f400/0xf32533d6ff7044d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7044dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227112:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813406.227116:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813406.227119:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813406.227121:0:22712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813406.227139:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a4166f400/0xf32533d6ff7044d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7044dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813406.227145:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:151fd599-5695-4163-8caa-7faa559323aa:3628:1875706313407872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813406.227160:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4166f400/0xf32533d6ff7044d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7044dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813406.227177:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813406.227179:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813406.227181:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813406.227191:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813406.227194:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:151fd599-5695-4163-8caa-7faa559323aa:3625:1875706313408000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813406.227230:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813406.227255:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313407872 00000100:00100000:2.0:1788813406.227261:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313407872 00010000:00010000:2.0:1788813406.227287:0:22710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7045e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7045d9 expref: 18 pid: 22718 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813406.227331:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313408000 00000100:00100000:2.0:1788813406.227335:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313408000 00000100:00100000:1.0:1788813406.227342:0:23876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23876:1875706313407616:0@lo:104: 00010000:00010000:2.0:1788813406.227351:0:22710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a821e5400/0xf32533d6ff7044dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7044d6 expref: 19 pid: 22718 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813406.227377:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813406.227384:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:151fd599-5695-4163-8caa-7faa559323aa+19:3628:x1875706313407872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813406.227508:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813406.227515:0:22710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7045e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7045d9 expref: 19 pid: 22718 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813406.227517:0:23876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23876:1875706313407744:0@lo:104: 00010000:00010000:2.0:1788813406.227535:0:22710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7045e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7045d9 expref: 19 pid: 22718 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.227547:0:23876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff704634 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227551:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7045e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7045d9 expref: 19 pid: 22718 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227571:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813406.227609:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:151fd599-5695-4163-8caa-7faa559323aa+18:3628:x1875706313407872:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813406.227617:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813406.227633:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788813406.227639:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:151fd599-5695-4163-8caa-7faa559323aa+17:3625:x1875706313408000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813406.227647:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813406.227651:0:22710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a821e5400/0xf32533d6ff7044dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7044d6 expref: 17 pid: 22718 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227672:0:22710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a821e5400/0xf32533d6ff7044dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7044d6 expref: 17 pid: 22718 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227690:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e5400/0xf32533d6ff7044dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7044d6 expref: 17 pid: 22718 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227703:0:22710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff704634 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813406.227711:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:151fd599-5695-4163-8caa-7faa559323aa:3628:1875706313407872:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813406.227712:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff704634 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227730:0:22710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff704634 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227738:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff704634 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227745:0:22710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff704634 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227750:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff704634 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227756:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813406.227760:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff704634 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227766:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff704634 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227782:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff704634 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.227801:0:23876:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff704634 lrc: 2/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.227804:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813406.227813:0:23876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff704634 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.227821:0:23876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff704634 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813406.227843:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:151fd599-5695-4163-8caa-7faa559323aa+16:3625:x1875706313408000:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813406.227852:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788813406.227890:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:151fd599-5695-4163-8caa-7faa559323aa:3625:1875706313408000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813407.078537:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813407.588081:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813397/real 1788813397] req@ffff948943488000 x1875706313402624/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813407 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813407.588115:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948943488000 x1875706313402624/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813407 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813407.588126:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813392/real 1788813392] req@ffff948943489500 x1875706313400192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813407 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813407.588141:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948943489500 x1875706313400192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813407 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813407.588150:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813392/real 1788813392] req@ffff948943488e00 x1875706313400320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813407 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813407.588161:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948943488e00 x1875706313400320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813407 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788813407.588180:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a74aa7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813407.588203:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788813407.588207:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313402624:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788813407.588213:0:3624:0:(import.c:65:import_set_state_nolock()) ffff9489437d8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813407.588218:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788813407.588250:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313400192:0@lo:8:kworker.0 00000100:00080000:3.0:1788813407.588256:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b57d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813407.588262:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788813407.588264:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313400320:0@lo:8:kworker.0 00000100:00080000:1.0:1788813407.590326:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813407.590332:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788813407.590336:0:8:0:(import.c:65:import_set_state_nolock()) ffff9489437d8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813407.590345:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 545 00000100:00080000:1.0:1788813407.590352:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:3.0:1788813407.590357:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313408256:0@lo:400:kworker.0 00000100:00080000:1.0:1788813407.590366:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9489437d8800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813407.590420:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948943488a80 x1875706313408384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813407.590437:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813407.590441:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788813407.590443:0:8:0:(import.c:65:import_set_state_nolock()) ffff948a7b57d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788813407.590445:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788813407.590446:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 545 00000100:00080000:1.0:1788813407.590449:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788813407.590455:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948a7b57d800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813407.590465:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94894348b800 x1875706313408512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813407.590486:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813407.590489:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788813407.590491:0:8:0:(import.c:65:import_set_state_nolock()) ffff948a74aa7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813407.590494:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 551 00000100:00100000:3.0:1788813407.590496:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1788813407.590496:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788813407.590500:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff948a74aa7800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813407.590502:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313408640:0@lo:400:kworker.0 00000100:00100000:1.0:1788813407.590509:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948943488000 x1875706313408896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813407.590517:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813407.590520:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788813407.590529:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813407.590552:0:23758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313408256 00000100:00100000:3.0:1788813407.590554:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313408640 00000100:00100000:3.0:1788813407.590559:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313408640 00000100:00100000:1.0:1788813407.590559:0:23758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313408256 00000100:00100000:3.0:1788813407.590605:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813407.590605:0:23758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788813407.590613:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313408640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813407.590622:0:23758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313408256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813407.590679:0:23758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313408256:12345-0@lo:400:kworker.0 Request processed in 57us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813407.590687:0:23758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788813407.590701:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313408640:12345-0@lo:400:kworker.0 Request processed in 81us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813407.590707:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788813407.590726:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948943488e00 x1875706313408640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813407.590728:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313408384:0@lo:8:kworker.0 00000100:00100000:1.0:1788813407.590740:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313408640:0@lo:400:kworker.0 00000100:00100000:1.0:1788813407.590750:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313408256:0@lo:400:kworker.0 00000400:00000100:3.0:1788813407.590751:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313408384 offset 0 length 520: 4 00000100:00100000:3.0:1788813407.590769:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313408512:0@lo:8:kworker.0 00000400:00000100:3.0:1788813407.590785:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313408512 offset 0 length 520: 4 00000100:00100000:3.0:1788813407.590795:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313408896:0@lo:8:kworker.0 00000400:00000100:3.0:1788813407.590811:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313408896 offset 0 length 520: 4 00000100:00100000:0.0:1788813407.591343:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313408128:0@lo:400:kworker.0 00000100:00100000:0.0:1788813407.591386:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813407.591475:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313409024:0@lo:400:kworker.0 00000100:00100000:0.0:1788813407.591500:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813407.591524:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313408768:0@lo:400:kworker.0 00000100:00100000:0.0:1788813407.591536:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313409024 00000100:00100000:0.0:1788813407.591541:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313409024 00000100:00100000:2.0:1788813407.591554:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813407.591572:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813407.591580:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313409024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813407.591678:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313408768 00000100:00100000:3.0:1788813407.591683:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313408768 00000100:00100000:0.0:1788813407.591699:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313409024:12345-0@lo:400:kworker.0 Request processed in 120us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813407.591706:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813407.591728:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788813407.591733:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313408768:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788813407.591738:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948943488380 x1875706313409024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813407.591749:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313409024:0@lo:400:kworker.0 00000100:00100000:3.0:1788813407.591763:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313408768:12345-0@lo:400:kworker.0 Request processed in 30us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813407.591768:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788813407.591835:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313408128 00000100:00100000:1.0:1788813407.591839:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313408128 00000100:00100000:1.0:1788813407.591873:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788813407.591881:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7557a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+16:3626:x1875706313408128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813407.591999:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7557a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+16:3626:x1875706313408128:12345-0@lo:400:kworker.0 Request processed in 119us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813407.592006:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788813407.592594:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313408768:0@lo:400:kworker.0 00000100:00100000:3.0:1788813407.592792:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313408128:0@lo:400:kworker.0 10000000:01000000:2.0:1788813408.101114:0:22720:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813408.101121:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a6eab6800 from 13 10000000:01000000:2.0:1788813408.101126:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813408.101172:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a81800/0xf32533d6ff70463b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813408.101184:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948941a81800/0xf32533d6ff70463b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813408.101197:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948941a81800/0xf32533d6ff70463b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813408.101224:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943126300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313409152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813408.101295:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813408.101342:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489433826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813408.101410:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313409152 00000100:00100000:0.0:1788813408.101425:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313409152 00000100:00100000:0.0:1788813408.101486:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788813408.101497:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7557b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+16:22720:x1875706313409152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813408.101510:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813408.101523:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cda400/0xf32533d6ff704642 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70463b expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813408.101547:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cda400/0xf32533d6ff704642 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70463b expref: 17 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813408.101557:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cda400/0xf32533d6ff704642 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70463b expref: 17 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813408.101566:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cda400, rc 0) 00000100:00100000:0.0:1788813408.101608:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7557b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+17:22720:x1875706313409152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813408.101615:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788813408.101672:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943126300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313409152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813408.101687:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948941a81800/0xf32533d6ff70463b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704642 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813408.101696:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948941a81800/0xf32533d6ff70463b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff704642 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813408.101755:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313409280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813408.101779:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813408.101798:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe6ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813408.101811:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313409280 00000100:00100000:0.0:1788813408.101821:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313409280 00000100:00100000:0.0:1788813408.101846:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788813408.101853:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a75578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+17:22720:x1875706313409280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813408.101981:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a75578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+17:22720:x1875706313409280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813408.101988:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788813408.102021:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313409280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813408.102048:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313409408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813408.102087:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813408.102101:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe6ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813408.102112:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313409408 00000100:00100000:0.0:1788813408.102116:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313409408 00000100:00100000:0.0:1788813408.102138:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788813408.102145:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7557b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+17:22720:x1875706313409408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813408.102220:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7557b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+17:22720:x1875706313409408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813408.102226:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788813408.102265:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313409408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788813408.102878:0:23950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788813408.102960:0:22720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788813408.102981:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813408.102989:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a81800/0xf32533d6ff70463b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704642 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813408.102999:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948941a81800/0xf32533d6ff70463b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704642 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813408.103021:0:22720:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788813408.103024:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9489430d0800 from 13 10000000:01000000:0.0:1788813408.103026:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813408.103048:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff704649 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813408.103056:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff704649 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813408.103065:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff704649 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813408.103079:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313409536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813408.103113:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813408.103132:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe6fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813408.103148:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313409536 00000100:00100000:0.0:1788813408.103152:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313409536 00000100:00100000:0.0:1788813408.103180:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788813408.103188:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7557bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+17:22720:x1875706313409536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813408.103197:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813408.103207:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cdac00/0xf32533d6ff704650 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff704649 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813408.103225:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdac00/0xf32533d6ff704650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff704649 expref: 18 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813408.103235:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cdac00/0xf32533d6ff704650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704649 expref: 18 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813408.103254:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdac00, rc 0) 00000100:00100000:0.0:1788813408.103286:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7557bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+18:22720:x1875706313409536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813408.103292:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788813408.103330:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313409536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813408.103343:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff704649 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704650 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813408.103352:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff704649 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff704650 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813408.103392:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313409664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813408.103418:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813408.103431:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe6fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813408.103442:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313409664 00000100:00100000:0.0:1788813408.103446:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313409664 00000100:00100000:0.0:1788813408.103467:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788813408.103473:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7557b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+18:22720:x1875706313409664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813408.103562:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7557b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+18:22720:x1875706313409664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813408.103568:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788813408.103597:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313409664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813408.103623:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313409792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813408.103674:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813408.103694:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe6fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813408.103708:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313409792 00000100:00100000:0.0:1788813408.103712:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313409792 00000100:00100000:0.0:1788813408.103731:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788813408.103737:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+18:22720:x1875706313409792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813408.103807:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+18:22720:x1875706313409792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813408.103813:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788813408.103849:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313409792:0@lo:503:ll_cfg_requeue.0 00010000:00010000:3.0:1788813408.105152:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788813408.106665:0:23951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788813408.106829:0:22720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788813408.106852:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813408.106864:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff704649 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704650 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813408.106876:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff704649 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704650 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813408.612414:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813398/real 1788813398] req@ffff948943489880 x1875706313402880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813408 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813408.612451:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948943489880 x1875706313402880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813408 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788813408.612475:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948941924000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813408.612503:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788813408.612508:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313402880:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788813408.612688:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813408.612692:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813408.612696:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813408.612699:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813408.612743:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813408.612747:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813408.612749:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813408.612752:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788813408.612754:0:8:0:(import.c:65:import_set_state_nolock()) ffff948941924000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813408.612759:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 551 00000100:00080000:2.0:1788813408.612764:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788813408.612774:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff948941924000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813408.612796:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948943124e00 x1875706313410304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813408.612829:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313410176:0@lo:400:kworker.0 00000100:00100000:2.0:1788813408.612890:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813408.612920:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813408.612925:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313410432:0@lo:400:kworker.0 00000100:00100000:2.0:1788813408.612970:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813408.612998:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313410176 00000100:00100000:2.0:1788813408.613005:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313410176 00000100:00100000:2.0:1788813408.613044:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788813408.613052:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313410176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813408.613100:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313410176:12345-0@lo:400:kworker.0 Request processed in 49us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813408.613106:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788813408.613152:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313410176:0@lo:400:kworker.0 00000100:00100000:3.0:1788813408.613354:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313409920:0@lo:400:kworker.0 00000100:00100000:3.0:1788813408.613386:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813408.613414:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813408.613420:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313410048:0@lo:400:kworker.0 00000100:00100000:3.0:1788813408.613440:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813408.613470:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313410432 00000100:00100000:3.0:1788813408.613474:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313410432 00000100:00100000:3.0:1788813408.613502:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313410048 00000100:00100000:3.0:1788813408.613505:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313410048 00000100:00100000:3.0:1788813408.613519:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813408.613525:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313410432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813408.613572:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313410432:12345-0@lo:400:kworker.0 Request processed in 47us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813408.613579:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813408.613593:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813408.613599:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313410048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813408.613629:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313410048:12345-0@lo:400:kworker.0 Request processed in 30us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813408.613649:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813408.613669:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313409920 00000100:00100000:3.0:1788813408.613672:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313409920 00000100:00100000:3.0:1788813408.613695:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813408.613701:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313409920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813408.613732:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313409920:12345-0@lo:400:kworker.0 Request processed in 31us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813408.613738:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788813408.613772:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948943127b80 x1875706313410048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813408.613783:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313410048:0@lo:400:kworker.0 00000100:00100000:3.0:1788813408.613793:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313409920:0@lo:400:kworker.0 00000100:00100000:3.0:1788813408.613814:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313410304:0@lo:8:kworker.0 00000400:00000100:3.0:1788813408.613839:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313410304 offset 0 length 520: 4 00010000:00080000:3.0:1788813408.613884:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948943124a80 x1875706313410432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813408.613893:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313410432:0@lo:400:kworker.0 00000100:00100000:3.0:1788813408.614372:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313410560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813408.614400:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813408.614428:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813408.614435:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313410688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813408.614459:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813408.614536:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313410560 00000100:00100000:2.0:1788813408.614547:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313410560 00000100:00100000:2.0:1788813408.614579:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313410688 00000100:00100000:2.0:1788813408.614582:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313410688 00000100:00100000:2.0:1788813408.614596:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788813408.614603:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313410560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813408.614628:0:22729:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788813408.614684:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313410560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813408.614690:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788813408.614705:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788813408.614711:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313410688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788813408.614728:0:22729:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788813408.614754:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313410688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813408.614761:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788813408.614964:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313410688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813408.614974:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313410560:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788813409.124116:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788813409.128866:0:23456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788813410.152863:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788813410.343113:0:23477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788813411.200247:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813412.260489:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813413.287108:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813413.732987:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813413.733013:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313410816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813413.733087:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813413.733151:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313410816 00000100:00100000:3.0:1788813413.733159:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313410816 00000100:00100000:3.0:1788813413.733205:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788813413.733228:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313410816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788813413.733261:0:22729:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788813413.733318:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313410816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813413.733325:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788813413.733371:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313410816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813413.733856:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813413.733869:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313410944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813413.733905:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788813413.734053:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813413.734057:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813413.734060:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813413.734063:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813413.734074:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813413.734077:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813413.734080:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813413.734083:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788813413.734117:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313411200:0@lo:400:kworker.0 00000100:00100000:1.0:1788813413.734149:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813413.734185:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813413.734191:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:151fd599-5695-4163-8caa-7faa559323aa:3628:1875706313411072:0@lo:400:kworker.0 00000100:00100000:1.0:1788813413.734229:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813413.734262:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313411072 00000100:00100000:1.0:1788813413.734268:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313411072 00000100:00100000:1.0:1788813413.734317:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788813413.734326:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+18:3628:x1875706313411072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813413.734368:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+18:3628:x1875706313411072:12345-0@lo:400:kworker.0 Request processed in 43us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813413.734375:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788813413.734418:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:151fd599-5695-4163-8caa-7faa559323aa:3628:1875706313411072:0@lo:400:kworker.0 00000100:00100000:3.0:1788813413.735032:0:23758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313410944 00000100:00100000:3.0:1788813413.735039:0:23758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313410944 00000100:00100000:3.0:1788813413.735074:0:23758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788813413.735081:0:23758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313410944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788813413.735108:0:23758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788813413.735159:0:23758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313410944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813413.735165:0:23758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788813413.735186:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313411200 00000100:00100000:3.0:1788813413.735190:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313411200 00000100:00100000:3.0:1788813413.735228:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813413.735236:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313411200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813413.735274:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313411200:12345-0@lo:400:kworker.0 Request processed in 39us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813413.735280:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788813413.736863:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313411328:0@lo:400:kworker.0 00000100:00100000:2.0:1788813413.736927:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813413.737013:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313410944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813413.737515:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313411328 00000100:00100000:3.0:1788813413.737524:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313411328 00000100:00100000:3.0:1788813413.737577:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788813413.737586:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313411328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813413.737672:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313411328:12345-0@lo:400:kworker.0 Request processed in 87us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813413.737679:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788813413.738962:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948943489880 x1875706313411200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813413.738990:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313411200:0@lo:400:kworker.0 00010000:00080000:2.0:1788813413.739481:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94894348aa00 x1875706313411328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813413.739492:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313411328:0@lo:400:kworker.0 00000020:01000004:1.0:1788813414.126782:0:24224:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788813414.126786:0:24224:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788813414.126787:0:24224:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788813414.126891:0:24224:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff948a6eae1000 00000020:01000004:1.0:1788813414.126907:0:24224:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788813414.126920:0:24224:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788813414.126956:0:24224:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff94894207b380) 00000020:00000080:1.0:1788813414.126973:0:24224:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788813414.235044:0:24224:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788813414.236814:0:24224:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788813414.237047:0:24224:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788813414.237541:0:24224:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788813414.238655:0:24224:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788813414.238869:0:24224:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788813414.239107:0:24224:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788813414.242664:0:24224:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788813414.242906:0:24224:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788813414.242919:0:24224:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788813414.243386:0:24224:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf32533d6ff70465e 00000020:01000004:3.0:1788813414.243397:0:24224:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788813414.243570:0:24224:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.113@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788813414.243574:0:24224:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788813414.243581:0:24224:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788813414.243597:0:24224:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788813414.243611:0:24224:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff948a7b7019c0) 00000020:00000080:0.0:1788813414.243625:0:24224:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788813414.244929:0:24224:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813414.245139:0:24224:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788813414.245146:0:24224:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788813414.255075:0:24224:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788813414.261106:0:24224:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788813414.261818:0:24224:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788813414.261830:0:24224:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788813414.265019:0:24224:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813414.265696:0:24224:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788813414.265706:0:24224:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788813414.270476:0:24224:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788813414.270492:0:24224:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788813414.303483:0:24224:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813414.303885:0:24224:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788813414.303893:0:24224:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788813414.305827:0:24224:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788813414.305839:0:24224:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788813414.307435:0:24224:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788813414.307451:0:24224:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00010000:00010000:0.0:1788813414.309029:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813414.311030:0:24224:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813414.311342:0:24224:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788813414.311349:0:24224:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788813414.311980:0:24224:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788813414.311987:0:24224:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788813414.345833:0:24224:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813414.346210:0:24224:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788813414.346230:0:24224:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788813414.347379:0:24224:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788813414.347389:0:24224:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788813414.347886:0:24224:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788813414.347920:0:24224:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788813414.347928:0:24224:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788813414.365774:0:24224:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788813414.365821:0:24224:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.113@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788813414.365826:0:24224:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788813414.365829:0:24224:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788813414.365830:0:24224:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813414.365831:0:24224:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813414.365833:0:24224:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813414.365834:0:24224:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813414.365836:0:24224:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788813414.365843:0:24224:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813414.365844:0:24224:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788813414.365848:0:24224:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788813414.365850:0:24224:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788813414.365851:0:24224:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788813414.365852:0:24224:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813414.365853:0:24224:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813414.365854:0:24224:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813414.365855:0:24224:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813414.365855:0:24224:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788813414.365856:0:24224:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813414.365857:0:24224:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788813414.365887:0:24224:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788813414.365909:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313411456:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788813414.366088:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813414.366194:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ec02840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813414.373065:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313411456 00000100:00100000:2.0:1788813414.373086:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313411456 00000100:00100000:2.0:1788813414.373164:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788813414.373174:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+18:24224:x1875706313411456:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788813414.374199:0:22718:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788813414.374205:0:22718:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788813414.374367:0:22718:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788813414.374919:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+18:24224:x1875706313411456:12345-0@lo:253:mount.lustre.0 Request processed in 1745us (8830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813414.374960:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788813414.378576:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313411456:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788813414.378607:0:24224:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788813414.378610:0:24224:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788813414.378612:0:24224:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788813414.378614:0:24224:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813414.378615:0:24224:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813414.378616:0:24224:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813414.378617:0:24224:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813414.378619:0:24224:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788813414.378621:0:24224:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813414.378623:0:24224:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788813414.378669:0:24224:0:(tgt_mount.c:101:server_register_mount()) register mount ffff948a6eae1000 from lustre-OST0000 10000000:01000000:0.0:1788813414.378704:0:24224:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788813414.378708:0:24224:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788813414.378715:0:24224:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff948a6edbb380 local copy 00010000:00010000:0.0:1788813414.378726:0:24224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704420 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813414.378855:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313411584:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813414.378925:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813414.379132:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ec023c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813414.379219:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313411584 00000100:00100000:1.0:1788813414.379229:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313411584 00000100:00100000:1.0:1788813414.379281:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788813414.379297:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+18:24224:x1875706313411584:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813414.379398:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+18:24224:x1875706313411584:12345-0@lo:501:mount.lustre.0 Request processed in 102us (473us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813414.379405:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788813414.379562:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313411584:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788813414.379578:0:24224:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788813414.379634:0:24224:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788813414.379640:0:24224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704420 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813414.379650:0:24224:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704420 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813414.379677:0:24224:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff948a6eae1000 10000000:01000000:2.0:1788813414.379681:0:24224:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788813414.379686:0:24224:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788813414.379689:0:24224:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788813414.379694:0:24224:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788813414.379696:0:24224:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788813414.379718:0:24224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff70466c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813414.379736:0:24224:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff70466c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813414.379746:0:24224:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff70466c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813414.379759:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313411712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788813414.379787:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813414.379807:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6eb2dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813414.379922:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313411712 00000100:00100000:1.0:1788813414.379927:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313411712 00000100:00100000:1.0:1788813414.379988:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788813414.379995:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+18:24224:x1875706313411712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813414.380003:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813414.380015:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8e00/0xf32533d6ff704673 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70466c expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.380035:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8e00/0xf32533d6ff704673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70466c expref: 19 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.380045:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8e00/0xf32533d6ff704673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70466c expref: 19 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.380053:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8e00, rc 0) 00000100:00100000:1.0:1788813414.380089:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+19:24224:x1875706313411712:12345-0@lo:101:mount.lustre.0 Request processed in 95us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.380095:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788813414.380249:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313411712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813414.380264:0:24224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff70466c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704673 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.380273:0:24224:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff70466c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff704673 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813414.381455:0:24224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1788813414.382187:0:24224:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813414.384467:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788813414.384509:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788813414.384533:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788813414.384545:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788813414.384570:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788813414.384591:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788813414.384607:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788813414.384619:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788813414.384630:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1788813414.384642:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1788813414.384653:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1788813414.384665:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1788813414.384689:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1788813414.384695:0:24224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1788813414.384794:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313411840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813414.384867:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813414.384916:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6104fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813414.385177:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313411840 00000100:00100000:2.0:1788813414.385186:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313411840 00000100:00100000:2.0:1788813414.385236:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788813414.385245:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+19:24224:x1875706313411840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813414.385402:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+19:24224:x1875706313411840:12345-0@lo:501:mount.lustre.0 Request processed in 157us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813414.385410:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788813414.385767:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313411840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813414.385810:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313411968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813414.385849:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813414.385870:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ec02180 going to sleep for 11 seconds 00000100:00100000:1.0:1788813414.385920:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313411968 00000100:00100000:1.0:1788813414.385925:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313411968 00000100:00100000:1.0:1788813414.385993:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788813414.386000:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+19:24224:x1875706313411968:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813414.387034:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+19:24224:x1875706313411968:12345-0@lo:503:mount.lustre.0 Request processed in 1032us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.387052:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788813414.387357:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313411968:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788813414.387873:0:24224:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813414.388112:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813414.388166:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813414.388202:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ec02180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813414.388285:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313412096 00000100:00100000:3.0:1788813414.388291:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313412096 00000100:00100000:3.0:1788813414.388339:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788813414.388348:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+19:24224:x1875706313412096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813414.388812:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+19:24224:x1875706313412096:12345-0@lo:502:mount.lustre.0 Request processed in 464us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813414.388821:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788813414.388904:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813414.389387:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788813414.389418:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788813414.389432:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788813414.389445:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788813414.389456:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788813414.389468:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788813414.389497:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788813414.389513:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788813414.389525:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788813414.389537:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788813414.389917:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788813414.402631:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788813414.402705:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813414.402802:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813414.402906:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6104f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813414.408658:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313412224 00000100:00100000:1.0:1788813414.408675:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313412224 00000100:00100000:1.0:1788813414.408805:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788813414.408817:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+19:24224:x1875706313412224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813414.409163:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+19:24224:x1875706313412224:12345-0@lo:502:mount.lustre.0 Request processed in 348us (6361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.409173:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788813414.409342:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788813414.409426:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788813414.409440:0:24224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788813414.411418:0:24241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788813414.411429:0:24241:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788813414.411436:0:24241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813414.411438:0:24241:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788813414.411445:0:24241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788813414.411463:0:24241:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff948a6adb3380) 00000020:00000080:3.0:1788813414.411492:0:24241:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788813414.411499:0:24241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788813414.411610:0:24241:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a6eae1000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788813414.411623:0:24241:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788813414.411631:0:24241:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf32533d6ff704681 00010000:00010000:3.0:1788813414.422690:0:24241:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788813414.423836:0:24241:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:3.0:1788813414.431277:0:24241:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788813414.433016:0:24241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788813414.433028:0:24241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813414.433037:0:24241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813414.433039:0:24241:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788813414.433051:0:24241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788813414.433054:0:24241:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788813414.433056:0:24241:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788813414.433058:0:24241:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788813414.433059:0:24241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788813414.433061:0:24241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813414.433063:0:24241:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788813414.433066:0:24241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813414.433069:0:24241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813414.433070:0:24241:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788813414.433073:0:24241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788813414.433075:0:24241:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788813414.433077:0:24241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813414.433079:0:24241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813414.433080:0:24241:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788813414.433082:0:24241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813414.433084:0:24241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813414.433085:0:24241:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788813414.433088:0:24241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788813414.433112:0:24241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813414.433115:0:24241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813414.433116:0:24241:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788813414.433119:0:24241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788813414.433426:0:24224:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788813414.433461:0:24224:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788813414.433487:0:24224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff70466c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704673 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813414.433499:0:24224:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948941a80600/0xf32533d6ff70466c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704673 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813414.433509:0:24224:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a6eae1000 from 1 10000000:01000000:2.0:1788813414.433512:0:24224:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813414.433562:0:24224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a81000/0xf32533d6ff704688 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813414.433577:0:24224:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948941a81000/0xf32533d6ff704688 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813414.433599:0:24224:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948941a81000/0xf32533d6ff704688 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813414.433625:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943126680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788813414.433698:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813414.433734:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ebfd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813414.437876:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313412352 00000100:00100000:2.0:1788813414.437891:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313412352 00000100:00100000:2.0:1788813414.439310:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788813414.439325:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+19:24224:x1875706313412352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813414.439345:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813414.439364:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948941a80200/0xf32533d6ff70468f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff704688 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813414.439393:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948941a80200/0xf32533d6ff70468f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff704688 expref: 20 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813414.439403:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948941a80200/0xf32533d6ff70468f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704688 expref: 20 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813414.439411:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948941a80200, rc 0) 00000100:00100000:2.0:1788813414.439506:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+20:24224:x1875706313412352:12345-0@lo:101:mount.lustre.0 Request processed in 185us (5807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813414.439513:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788813414.439624:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943126680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412352:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813414.439644:0:24224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948941a81000/0xf32533d6ff704688 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70468f expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813414.439653:0:24224:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948941a81000/0xf32533d6ff704688 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70468f expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813414.445669:0:24224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788813414.445980:0:24224:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813414.446150:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788813414.446186:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788813414.446200:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788813414.446228:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788813414.446240:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788813414.446251:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788813414.446262:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788813414.446273:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788813414.446285:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788813414.446296:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788813414.446307:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788813414.446344:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788813414.446351:0:24224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788813414.446436:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813414.446506:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813414.453564:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ec026c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813414.453664:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313412480 00000100:00100000:1.0:1788813414.453674:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313412480 00000100:00100000:1.0:1788813414.453719:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788813414.453728:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+20:24224:x1875706313412480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813414.454187:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+20:24224:x1875706313412480:12345-0@lo:501:mount.lustre.0 Request processed in 459us (7679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.454196:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788813414.454311:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813414.454358:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412608:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813414.454406:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813414.454467:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ec026c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813414.454495:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313412608 00000100:00100000:2.0:1788813414.454500:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313412608 00000100:00100000:2.0:1788813414.454620:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788813414.454627:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+20:24224:x1875706313412608:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813414.454756:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+20:24224:x1875706313412608:12345-0@lo:503:mount.lustre.0 Request processed in 130us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813414.454763:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788813414.461637:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412608:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788813414.462364:0:24224:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813414.462488:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412736:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813414.462720:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.462809:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894229a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813414.465682:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313412736 00000100:00100000:2.0:1788813414.465700:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313412736 00000100:00100000:2.0:1788813414.465809:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788813414.465821:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+20:24224:x1875706313412736:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813414.466819:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+20:24224:x1875706313412736:12345-0@lo:502:mount.lustre.0 Request processed in 997us (4094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813414.466830:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788813414.466959:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412736:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813414.467272:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788813414.467309:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788813414.467322:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788813414.467335:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788813414.467360:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788813414.467391:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788813414.467406:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788813414.467419:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788813414.467432:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788813414.467447:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788813414.467460:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788813414.467502:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412864:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813414.467567:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.469434:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894229a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788813414.469561:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313412864 00000100:00100000:0.0:1788813414.469570:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313412864 00000100:00100000:0.0:1788813414.469630:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788813414.469640:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+20:24224:x1875706313412864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813414.469803:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+20:24224:x1875706313412864:12345-0@lo:502:mount.lustre.0 Request processed in 165us (2234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813414.469811:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788813414.476594:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813414.476703:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788813414.476717:0:24224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788813414.477760:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813414.477770:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813414.477778:0:24245:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788813414.477784:0:24245:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a6eae1000 00000020:00000080:0.0:1788813414.477787:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813414.477795:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813414.477797:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813414.477798:0:24245:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788813414.477800:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813414.477803:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813414.477804:0:24245:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788813414.477807:0:24245:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a6eae1000 00000020:00000080:0.0:1788813414.477809:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813414.477868:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813414.477872:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813414.477873:0:24245:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788813414.477876:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813414.477879:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813414.477880:0:24245:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788813414.477883:0:24245:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a6eae1000 00000020:00000080:0.0:1788813414.477886:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813414.477903:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813414.477906:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813414.477907:0:24245:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788813414.477909:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813414.477912:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813414.477913:0:24245:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788813414.477916:0:24245:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a6eae1000 00000020:00000080:0.0:1788813414.477918:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813414.477963:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813414.477967:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813414.477969:0:24245:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788813414.477972:0:24245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788813414.479001:0:24224:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788813414.479037:0:24224:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813414.479054:0:24224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a81000/0xf32533d6ff704688 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70468f expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813414.479073:0:24224:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948941a81000/0xf32533d6ff704688 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70468f expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813414.479128:0:24224:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788813414.479132:0:24224:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff948a6eae1000 10000000:01000000:0.0:1788813414.479135:0:24224:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff948a6eae1000 10000000:01000000:0.0:1788813414.479138:0:24224:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788813414.479144:0:24224:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a6eae1000 from 1 10000000:01000000:0.0:1788813414.479147:0:24224:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788813414.479187:0:24224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff704696 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813414.479195:0:24224:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff704696 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813414.479223:0:24224:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff704696 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813414.479249:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813414.479323:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813414.479370:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ec02180 going to sleep for 11 seconds 00000100:00100000:0.0:1788813414.479403:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313412992 00000100:00100000:0.0:1788813414.479411:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313412992 00000100:00100000:0.0:1788813414.479454:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788813414.479462:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+20:24224:x1875706313412992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813414.479476:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813414.479490:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cdb400/0xf32533d6ff70469d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff704696 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813414.479527:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdb400/0xf32533d6ff70469d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff704696 expref: 21 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813414.479536:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cdb400/0xf32533d6ff70469d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704696 expref: 21 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813414.479741:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdb400, rc 0) 00000100:00100000:0.0:1788813414.479787:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+21:24224:x1875706313412992:12345-0@lo:101:mount.lustre.0 Request processed in 325us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813414.479795:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788813414.479846:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313412992:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813414.479860:0:24224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff704696 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70469d expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813414.479870:0:24224:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff704696 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70469d expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813414.484790:0:24224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788813414.485141:0:24224:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813414.487834:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788813414.487888:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788813414.487904:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788813414.487916:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788813414.487948:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788813414.487966:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788813414.487981:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788813414.487994:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788813414.488006:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788813414.488029:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788813414.488042:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788813414.488054:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788813414.488081:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788813414.488095:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788813414.488107:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788813414.488118:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788813414.488132:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788813414.488145:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788813414.488158:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788813414.488171:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788813414.488184:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788813414.488197:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788813414.491868:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788813414.491928:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788813414.491975:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788813414.491989:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788813414.492001:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788813414.492013:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788813414.492039:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788813414.492053:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788813414.492065:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788813414.492079:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788813414.492092:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788813414.492104:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788813414.492118:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788813414.492132:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788813414.492144:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788813414.492158:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788813414.492171:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788813414.492182:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788813414.492193:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788813414.492204:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788813414.492226:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788813414.492239:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788813414.492265:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788813414.492279:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788813414.492292:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788813414.492306:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788813414.492470:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788813414.492490:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788813414.492506:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788813414.492511:0:24224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788813414.492650:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313413120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813414.492715:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813414.492763:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ec02300 going to sleep for 11 seconds 00000100:00100000:2.0:1788813414.498986:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313413120 00000100:00100000:2.0:1788813414.499004:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313413120 00000100:00100000:2.0:1788813414.499071:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788813414.499082:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+21:24224:x1875706313413120:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813414.499276:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+21:24224:x1875706313413120:12345-0@lo:501:mount.lustre.0 Request processed in 196us (6559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813414.499284:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788813414.499389:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313413120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813414.499453:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313413248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813414.499505:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813414.499536:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ec02300 going to sleep for 11 seconds 00000100:00100000:2.0:1788813414.499658:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313413248 00000100:00100000:2.0:1788813414.499663:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313413248 00000100:00100000:2.0:1788813414.499690:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788813414.499697:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+21:24224:x1875706313413248:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813414.499775:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+21:24224:x1875706313413248:12345-0@lo:503:mount.lustre.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813414.499792:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788813414.499862:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313413248:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788813414.500310:0:24224:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813414.500379:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313413376:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813414.500419:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813414.500441:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ec02180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813414.502322:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313413376 00000100:00100000:2.0:1788813414.502337:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313413376 00000100:00100000:2.0:1788813414.502399:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788813414.502410:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+21:24224:x1875706313413376:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813414.502592:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+21:24224:x1875706313413376:12345-0@lo:502:mount.lustre.0 Request processed in 174us (2162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813414.502600:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788813414.505963:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313413376:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813414.506231:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788813414.506264:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788813414.506276:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788813414.506287:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788813414.506306:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788813414.506319:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788813414.506347:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788813414.506359:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788813414.506371:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788813414.506381:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788813414.506392:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788813414.506403:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788813414.506414:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788813414.506424:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788813414.506435:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788813414.506445:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788813414.506456:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788813414.506467:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788813414.506477:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788813414.506488:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788813414.506498:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788813414.506509:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788813414.506530:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788813414.506541:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788813414.506728:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788813414.506740:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788813414.506750:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788813414.506761:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788813414.506772:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788813414.506782:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788813414.506794:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788813414.506806:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788813414.506817:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788813414.506827:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788813414.506838:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788813414.506848:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788813414.506861:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788813414.506885:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788813414.506909:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788813414.506921:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788813414.508125:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788813414.508158:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788813414.508170:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788813414.508181:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788813414.508192:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788813414.508202:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788813414.508227:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788813414.508239:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788813414.508290:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313413504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813414.508363:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813414.508408:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ec02180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813414.509374:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313413504 00000100:00100000:3.0:1788813414.509384:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313413504 00000100:00100000:3.0:1788813414.509434:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788813414.509442:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+21:24224:x1875706313413504:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813414.509578:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+21:24224:x1875706313413504:12345-0@lo:502:mount.lustre.0 Request processed in 136us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813414.509595:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788813414.511901:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313413504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813414.512195:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788813414.517663:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788813414.517738:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313413632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813414.517841:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.517891:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813414.520916:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313413632 00000100:00100000:0.0:1788813414.520960:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313413632 00000100:00100000:0.0:1788813414.521028:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788813414.521038:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+21:24224:x1875706313413632:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813414.521228:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+21:24224:x1875706313413632:12345-0@lo:502:mount.lustre.0 Request processed in 191us (3387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813414.521236:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788813414.529756:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313413632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813414.529874:0:24224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788813414.529889:0:24224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788813414.533451:0:24249:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788813414.533470:0:24249:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9489420799c0) 00000020:00000080:1.0:1788813414.533497:0:24249:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788813414.533596:0:24249:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a6eae1000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788813414.533600:0:24249:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a6eae1000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788813414.533603:0:24249:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a6eae1000 3 00010000:00080000:1.0:1788813414.533647:0:24249:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a7b795000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813414.542789:0:24249:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788813414.546264:0:24249:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788813414.546312:0:24249:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788813414.546327:0:24249:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf32533d6ff7046ab 00000100:00080000:1.0:1788813414.546340:0:24249:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813414.546351:0:24249:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff948a7b795000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813414.546389:0:24249:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948943488e00 x1875706313413760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788813414.546435:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313413760:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788813414.546501:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.546560:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313413760 00000100:00100000:1.0:1788813414.546568:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313413760 00000100:00100000:1.0:1788813414.553324:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813414.553338:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1875706313413760:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788813414.553370:0:22723:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:1.0:1788813414.553417:0:22723:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf32533d6ff7046b2 00000004:00100000:1.0:1788813414.553436:0:22723:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788813414.553475:0:22723:0:(import.c:65:import_set_state_nolock()) ffff948a59639000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813414.553589:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875706313413760:12345-0@lo:38:llog_process_th.0 Request processed in 242us (7077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.553597:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788813414.553650:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948943488e00 x1875706313413760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813414.553662:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813414.553670:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788813414.553690:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788813414.553694:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788813414.553697:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b795000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788813414.553703:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313413760:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788813414.553726:0:24249:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788813414.553778:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813414.553782:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813414.553784:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813414.553787:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813414.553812:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813414.553815:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813414.553817:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813414.553820:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788813414.553850:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313413888:0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.553887:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.553914:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813414.553920:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313414272:0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.553963:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.554000:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313414016:0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.554021:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.554038:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813414.554043:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313414144:0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.554061:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.554105:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313413888 00000100:00100000:1.0:1788813414.554112:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313413888 00000100:00100000:1.0:1788813414.554138:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313414144 00000100:00100000:1.0:1788813414.554141:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313414144 00000100:00100000:1.0:1788813414.554155:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788813414.554161:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313413888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.554198:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313413888:12345-0@lo:400:kworker.0 Request processed in 37us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.554203:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788813414.554214:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813414.554219:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313414144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.554244:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313414144:12345-0@lo:400:kworker.0 Request processed in 25us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.554249:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813414.554266:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313414272 00000100:00100000:1.0:1788813414.554270:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313414272 00000100:00100000:1.0:1788813414.554284:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313414016 00000100:00100000:1.0:1788813414.554286:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313414016 00000100:00100000:1.0:1788813414.554295:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813414.554300:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313414272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.554326:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313414272:12345-0@lo:400:kworker.0 Request processed in 25us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.554331:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813414.554342:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813414.554347:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313414016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.554372:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313414016:12345-0@lo:400:kworker.0 Request processed in 24us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.554386:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813414.554424:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313414144:0@lo:400:kworker.0 00010000:00080000:1.0:1788813414.554434:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94894348aa00 x1875706313414016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813414.554442:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313414016:0@lo:400:kworker.0 00010000:00080000:1.0:1788813414.554466:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948943489c00 x1875706313414272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813414.554473:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313414272:0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.554481:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313413888:0@lo:400:kworker.0 00000020:01000004:1.0:1788813414.568824:0:24249:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788813414.568843:0:24249:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff948942078000) 00000020:00000080:1.0:1788813414.568868:0:24249:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788813414.569011:0:24249:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a6eae1000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788813414.569015:0:24249:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a6eae1000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788813414.569018:0:24249:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a6eae1000 3 00010000:00080000:1.0:1788813414.569049:0:24249:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a7b791000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.113@tcp at head 00010000:00010000:0.0:1788813414.576913:0:24249:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788813414.577663:0:24249:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788813414.577714:0:24249:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788813414.577727:0:24249:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf32533d6ff7046c0 00000100:00080000:0.0:1788813414.577738:0:24249:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788813414.577750:0:24249:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff948a7b791000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813414.577786:0:24249:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489443b3800 x1875706313414400/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813414.577830:0:24249:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788813414.577959:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1875706313414400:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788813414.578024:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.578082:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313414400 00000100:00100000:1.0:1788813414.578088:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313414400 00000100:00100000:1.0:1788813414.578117:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813414.578123:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313414400:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788813414.578148:0:22725:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:1.0:1788813414.578177:0:22725:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf32533d6ff7046c7 00000004:00100000:1.0:1788813414.578197:0:22725:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788813414.578242:0:22725:0:(import.c:65:import_set_state_nolock()) ffff948a7b793000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813414.578288:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875706313414400:12345-0@lo:38:llog_process_th.0 Request processed in 164us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.578296:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788813414.578333:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9489443b3800 x1875706313414400/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813414.578343:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813414.578351:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788813414.578357:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788813414.578362:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788813414.578363:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b791000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788813414.578369:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1875706313414400:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788813414.585344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813414.585354:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813414.585357:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813414.585359:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813414.585364:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813414.585366:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813414.585369:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813414.585372:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788813414.590794:0:24249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788813414.591031:0:24224:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788813414.591064:0:24224:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788813414.591087:0:24224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff704696 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70469d expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.591100:0:24224:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff704696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70469d expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788813414.591156:0:24224:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788813414.591158:0:24224:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788813414.591159:0:24224:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813414.591161:0:24224:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813414.591162:0:24224:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813414.591164:0:24224:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813414.591166:0:24224:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813414.591168:0:24224:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813414.591174:0:24224:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788813414.591178:0:24224:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788813414.591180:0:24224:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788813414.591181:0:24224:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788813414.591182:0:24224:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813414.591183:0:24224:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813414.591184:0:24224:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813414.591185:0:24224:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813414.591185:0:24224:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813414.591186:0:24224:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813414.591187:0:24224:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788813414.591231:0:24224:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788813414.591254:0:24224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46540a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313414528:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788813414.591332:0:24224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.591367:0:24224:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46c9a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788813414.592023:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313414528 00000100:00100000:0.0:1788813414.592032:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313414528 00000100:00100000:0.0:1788813414.592087:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788813414.592096:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+21:24224:x1875706313414528:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788813414.592124:0:22718:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788813414.592137:0:22718:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788813414.593987:0:22718:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788813414.594005:0:22718:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788813414.594110:0:22739:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788813414.594117:0:22739:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788813414.594139:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a821e5600/0xf32533d6ff7046ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594158:0:22739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a4166fa00/0xf32533d6ff704618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704611 expref: 21 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594166:0:22739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a4166ec00/0xf32533d6ff704626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70461f expref: 21 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594173:0:22739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948a821e5600/0xf32533d6ff7046ce lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594224:0:22739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a4166ec00/0xf32533d6ff704626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff70461f expref: 21 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594239:0:22739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a4166ec00/0xf32533d6ff704626 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff70461f expref: 21 pid: 22718 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813414.594268:0:22739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22739:1875706313414656:0@lo:104: 00000100:00100000:3.0:1788813414.594333:0:22739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813414.594384:0:22739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a4166fa00/0xf32533d6ff704618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff704611 expref: 21 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594393:0:22739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a4166fa00/0xf32533d6ff704618 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff704611 expref: 21 pid: 22717 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813414.594403:0:22739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22739:1875706313414784:0@lo:104: 00000100:00100000:3.0:1788813414.594429:0:22739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813414.594460:0:22739:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813414.594486:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788813414.594502:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313414656 00000100:00100000:3.0:1788813414.594510:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313414656 00000100:00100000:3.0:1788813414.594552:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313414784 00000100:00100000:3.0:1788813414.594555:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313414784 00000100:00100000:3.0:1788813414.594569:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788813414.594577:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+4:22739:x1875706313414656:12345-0@lo:104: 00010000:00010000:3.0:1788813414.594600:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a4166e800/0xf32533d6ff70461f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff704626 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594654:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813414.594661:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+4:22739:x1875706313414656:12345-0@lo:104: Request processed in 84us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813414.594668:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788813414.594684:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813414.594690:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a75578850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+3:22739:x1875706313414784:12345-0@lo:104: 00010000:00010000:3.0:1788813414.594703:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9c00/0xf32533d6ff704611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff704618 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594730:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788813414.594734:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a75578850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+3:22739:x1875706313414784:12345-0@lo:104: Request processed in 46us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813414.594740:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788813414.594778:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813414.594785:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a4166e800/0xf32533d6ff70461f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff704626 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594793:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166e800 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813414.594797:0:22712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a4166e800/0xf32533d6ff70461f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff704626 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594806:0:22712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4166e800/0xf32533d6ff70461f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff704626 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813414.594813:0:22712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4166e800/0xf32533d6ff70461f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff704626 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813414.594819:0:22712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813414.594848:0:22712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a4166e800/0xf32533d6ff70461f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff704626 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594855:0:22712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813414.594871:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a4166e800/0xf32533d6ff70461f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff704626 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594878:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4166e800/0xf32533d6ff70461f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff704626 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594900:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813414.594903:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9c00/0xf32533d6ff704611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff704618 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594909:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9c00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813414.594912:0:22712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9c00/0xf32533d6ff704611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff704618 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594919:0:22712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9c00/0xf32533d6ff704611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff704618 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813414.594925:0:22712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9c00/0xf32533d6ff704611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff704618 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813414.594952:0:22712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813414.594965:0:22712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9c00/0xf32533d6ff704611 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff704618 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594971:0:22712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813414.594983:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9c00/0xf32533d6ff704611 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff704618 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.594990:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9c00/0xf32533d6ff704611 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff704618 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813414.595003:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813414.595004:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813414.595006:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813414.595038:0:22739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22739:1875706313414656:0@lo:104: 00000100:00100000:3.0:1788813414.595058:0:22739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22739:1875706313414784:0@lo:104: 00010000:00010000:3.0:1788813414.595079:0:22739:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948a821e5600/0xf32533d6ff7046ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.595423:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813414.595437:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313414912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813414.595476:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.595528:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313415040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813414.595562:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.595611:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313414912 00000100:00100000:1.0:1788813414.595616:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313414912 00010000:00010000:1.0:1788813414.595637:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a4166ec00/0xf32533d6ff704626 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70461f expref: 22 pid: 22718 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813414.595657:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313415040 00000100:00100000:1.0:1788813414.595660:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313415040 00010000:00010000:1.0:1788813414.595671:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a4166fa00/0xf32533d6ff704618 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff704611 expref: 23 pid: 22717 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813414.595683:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813414.595697:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:151fd599-5695-4163-8caa-7faa559323aa+23:3626:x1875706313414912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813414.595707:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813414.595712:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a4166ec00/0xf32533d6ff704626 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70461f expref: 23 pid: 22718 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.595722:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a4166ec00/0xf32533d6ff704626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff70461f expref: 23 pid: 22718 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.595734:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a4166ec00/0xf32533d6ff704626 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff70461f expref: 23 pid: 22718 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.595747:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813414.595775:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:151fd599-5695-4163-8caa-7faa559323aa+22:3626:x1875706313414912:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.595781:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813414.595797:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813414.595803:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a74bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:151fd599-5695-4163-8caa-7faa559323aa+21:3627:x1875706313415040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813414.595810:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813414.595814:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a4166fa00/0xf32533d6ff704618 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff704611 expref: 21 pid: 22717 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.595823:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a4166fa00/0xf32533d6ff704618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff704611 expref: 21 pid: 22717 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.595833:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a4166fa00/0xf32533d6ff704618 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff704611 expref: 21 pid: 22717 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.595844:0:22708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948a821e5600/0xf32533d6ff7046ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.595863:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e5600/0xf32533d6ff7046ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788813414.595877:0:22708:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004833932s 00010000:00010000:1.0:1788813414.595882:0:22708:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a821e5600/0xf32533d6ff7046ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.595889:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a821e5600/0xf32533d6ff7046ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.595895:0:22708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a821e5600/0xf32533d6ff7046ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.595902:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a821e5600/0xf32533d6ff7046ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.595908:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813414.595912:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a821e5600/0xf32533d6ff7046ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.595920:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a821e5600/0xf32533d6ff7046ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.595958:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a821e5600/0xf32533d6ff7046ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.595968:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813414.595996:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a74bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:151fd599-5695-4163-8caa-7faa559323aa+20:3627:x1875706313415040:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.596002:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813414.596065:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313415040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813414.596120:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+19:24224:x1875706313414528:12345-0@lo:253:mount.lustre.0 Request processed in 4025us (4788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.596128:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788813414.596407:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313414912:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813414.596427:0:22739:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948a821e5600/0xf32533d6ff7046ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.596434:0:22739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a821e5600/0xf32533d6ff7046ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813414.596440:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e5600/0xf32533d6ff7046ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813414.596464:0:24224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46540a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:24224:1875706313414528:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788813414.596474:0:24224:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788813414.596477:0:24224:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788813414.596479:0:24224:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788813414.596480:0:24224:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813414.596482:0:24224:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813414.596483:0:24224:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813414.596484:0:24224:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813414.596485:0:24224:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813414.596487:0:24224:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813414.596488:0:24224:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788813414.596496:0:24224:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1788813414.598832:0:24224:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788813414.614065:0:24224:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788813414.614074:0:24224:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788813414.614106:0:24224:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788813414.614142:0:24224:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.113@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788813414.614170:0:24224:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788813414.614190:0:24224:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788813414.615605:0:24224:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788813414.615852:0:24224:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788813414.640971:0:22759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788813415.332966:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788813415.562720:0:24304:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788813415.563504:0:24304:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788813416.357708:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788813416.359517:0:22720:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788813416.359524:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a6eab6800 from 13 10000000:01000000:1.0:1788813416.359611:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788813416.359850:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff7046d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813416.359862:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff7046d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813416.359874:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff7046d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813416.359902:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46540a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313415168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813416.360254:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813416.360345:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4634ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813416.360397:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313415168 00000100:00100000:0.0:1788813416.360406:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313415168 00000100:00100000:0.0:1788813416.360494:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788813416.360504:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+19:22720:x1875706313415168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813416.360518:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813416.360608:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cda600/0xf32533d6ff7046dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7046d5 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813416.360764:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cda600/0xf32533d6ff7046dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7046d5 expref: 20 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813416.360777:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cda600/0xf32533d6ff7046dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7046d5 expref: 20 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813416.360787:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cda600, rc 0) 00000100:00100000:0.0:1788813416.360848:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+20:22720:x1875706313415168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 346us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813416.360855:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788813416.360960:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46540a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313415168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813416.360977:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff7046d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7046dc expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813416.360986:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff7046d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7046dc expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813416.361060:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313415296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788813416.361092:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813416.361455:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313415296 00000100:00100000:1.0:1788813416.361461:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313415296 00000100:00100000:1.0:1788813416.361487:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788813416.361494:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+20:22720:x1875706313415296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788813416.361508:0:22716:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788813416.361524:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788813416.361598:0:22716:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788813416.361676:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+20:22720:x1875706313415296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 182us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813416.361683:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788813416.361866:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813416.361881:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313415296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788813416.362199:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788813416.362207:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff7046d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7046dc expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813416.362226:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff7046d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7046dc expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813416.362236:0:22720:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788813416.362238:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9489430d0800 from 13 10000000:01000000:2.0:1788813416.362241:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788813416.362263:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a80000/0xf32533d6ff7046e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813416.362271:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948941a80000/0xf32533d6ff7046e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813416.362280:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948941a80000/0xf32533d6ff7046e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813416.362293:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313415424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813416.362323:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813416.362392:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813416.362420:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313415424 00000100:00100000:1.0:1788813416.362425:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313415424 00000100:00100000:1.0:1788813416.362485:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788813416.362492:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+20:22720:x1875706313415424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813416.362502:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813416.362513:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7046ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7046e3 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813416.362615:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7046ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7046e3 expref: 21 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813416.362624:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7046ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7046e3 expref: 21 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813416.362631:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8200, rc 0) 00000100:00100000:1.0:1788813416.362679:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+21:22720:x1875706313415424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813416.362686:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788813416.362766:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313415424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813416.362778:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948941a80000/0xf32533d6ff7046e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7046ea expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813416.362786:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948941a80000/0xf32533d6ff7046e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7046ea expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813416.362831:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313415552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788813416.362859:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813416.366233:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813416.367962:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313415552 00000100:00100000:0.0:1788813416.367977:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313415552 00000100:00100000:0.0:1788813416.368136:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788813416.368161:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+21:22720:x1875706313415552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788813416.368189:0:22717:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788813416.368207:0:22717:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788813416.368211:0:22717:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788813416.368356:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+21:22720:x1875706313415552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 197us (5495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813416.368365:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788813416.368586:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313415552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788813416.368679:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788813416.368691:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948941a80000/0xf32533d6ff7046e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7046ea expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813416.368703:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948941a80000/0xf32533d6ff7046e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7046ea expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813417.385659:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813418.404291:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813418.853091:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813418.853123:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313415680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813418.853196:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813418.853253:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313415680 00000100:00100000:1.0:1788813418.853261:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313415680 00000100:00100000:1.0:1788813418.853309:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813418.853317:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313415680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788813418.853359:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788813418.853406:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313415680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813418.853424:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813418.853474:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313415680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813418.857878:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813418.857903:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313415808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813418.858003:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813418.858120:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313415808 00000100:00100000:2.0:1788813418.858129:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313415808 00000100:00100000:2.0:1788813418.858167:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788813418.858175:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313415808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813418.858209:0:22729:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788813418.858262:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313415808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813418.858268:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813418.858479:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313415808:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788813419.429774:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788813419.879103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813419.879109:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813419.879112:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813419.879115:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813419.879130:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813419.879133:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813419.879136:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813419.879139:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788813419.879177:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313416320:0@lo:400:kworker.0 00000100:00100000:0.0:1788813419.879250:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813419.879291:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788813419.879297:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:151fd599-5695-4163-8caa-7faa559323aa:3625:1875706313415936:0@lo:400:kworker.0 00000100:00100000:0.0:1788813419.879325:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813419.880049:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313416448:0@lo:400:kworker.0 00000100:00100000:0.0:1788813419.880088:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813419.880303:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313416064:0@lo:400:kworker.0 00000100:00100000:0.0:1788813419.880356:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813419.880377:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313416576:0@lo:400:kworker.0 00000100:00100000:0.0:1788813419.880402:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813419.887638:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788813419.887660:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313416192:0@lo:400:kworker.0 00000100:00100000:0.0:1788813419.887717:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813419.892487:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313415936 00000100:00100000:1.0:1788813419.892503:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313415936 00000100:00100000:1.0:1788813419.892571:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788813419.892582:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a4a623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+21:3625:x1875706313415936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813419.892679:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a4a623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+21:3625:x1875706313415936:12345-0@lo:400:kworker.0 Request processed in 99us (13352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813419.892687:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788813419.892729:0:23758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313416320 00000100:00100000:1.0:1788813419.892733:0:23758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313416320 00000100:00100000:1.0:1788813419.892758:0:23758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313416064 00000100:00100000:1.0:1788813419.892761:0:23758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313416064 00000100:00100000:1.0:1788813419.892775:0:23758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788813419.892781:0:23758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313416320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813419.892818:0:23758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313416320:12345-0@lo:400:kworker.0 Request processed in 37us (13568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813419.892823:0:23758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788813419.892833:0:23758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788813419.892839:0:23758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313416064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813419.892866:0:23758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313416064:12345-0@lo:400:kworker.0 Request processed in 28us (12510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813419.892871:0:23758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788813419.892922:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:151fd599-5695-4163-8caa-7faa559323aa:3625:1875706313415936:0@lo:400:kworker.0 00000100:00100000:1.0:1788813419.892989:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313416320:0@lo:400:kworker.0 00000100:00100000:2.0:1788813419.902562:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313416448 00000100:00100000:2.0:1788813419.902575:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313416448 00000100:00100000:2.0:1788813419.902720:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313416576 00000100:00100000:2.0:1788813419.902725:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313416576 00000100:00100000:2.0:1788813419.902775:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788813419.902785:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313416448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813419.902892:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313416448:12345-0@lo:400:kworker.0 Request processed in 108us (22802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813419.902899:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788813419.902916:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788813419.902923:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313416576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813419.902980:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313416576:12345-0@lo:400:kworker.0 Request processed in 59us (22577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813419.902988:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788813419.903029:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489443b0000 x1875706313416448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813419.903044:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313416448:0@lo:400:kworker.0 00000100:00080000:2.0:1788813419.903141:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813419.903712:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313416704:0@lo:400:kworker.0 00000100:00100000:0.0:1788813419.903763:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813419.903792:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313416064:0@lo:400:kworker.0 00010000:00080000:0.0:1788813419.903803:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489443b1c00 x1875706313416576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813419.903813:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313416576:0@lo:400:kworker.0 00000100:00100000:0.0:1788813419.903854:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313416192 00000100:00100000:0.0:1788813419.903859:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313416192 00000100:00100000:0.0:1788813419.903881:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313416704 00000100:00100000:0.0:1788813419.903884:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313416704 00000100:00080000:0.0:1788813419.903899:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813419.903915:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788813419.903921:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313416192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813419.903982:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313416192:12345-0@lo:400:kworker.0 Request processed in 62us (16265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813419.903989:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788813419.904003:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788813419.904009:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313416704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813419.904035:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313416704:12345-0@lo:400:kworker.0 Request processed in 27us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813419.904049:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788813419.904075:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489443b2680 x1875706313416192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813419.904085:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313416192:0@lo:400:kworker.0 00010000:00080000:0.0:1788813419.904094:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489443b3800 x1875706313416704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813419.904101:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313416704:0@lo:400:kworker.0 00010000:00010000:2.0:1788813420.452299:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788813420.587292:0:23477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788813421.477972:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788813422.424514:0:24594:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788813422.501976:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813422.766602:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813407/real 1788813407] req@ffff948943488000 x1875706313408896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813422 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813422.766636:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948943488000 x1875706313408896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813422 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788813422.766882:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a74aa7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813422.766904:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788813422.766908:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313408896:0@lo:8:kworker.0 00000100:00080000:0.0:1788813422.767038:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813422.767042:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813422.767045:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813422.767048:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813422.767074:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813422.767077:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788813422.767080:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a74aa7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813422.767084:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 560 00000100:00080000:0.0:1788813422.767090:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788813422.767101:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff948a74aa7800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813422.767118:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a76406d80 x1875706313417344/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813422.767129:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813422.767132:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788813422.767178:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313417088:0@lo:400:kworker.0 00000100:00100000:0.0:1788813422.767238:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813422.767265:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313417728:0@lo:400:kworker.0 00000100:00100000:0.0:1788813422.767285:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813422.767304:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813422.767310:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313417216:0@lo:400:kworker.0 00000100:00100000:0.0:1788813422.767334:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813422.767366:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313417088 00000100:00100000:0.0:1788813422.767374:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313417088 00000100:00100000:0.0:1788813422.767412:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313417728 00000100:00100000:0.0:1788813422.767415:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313417728 00000100:00100000:0.0:1788813422.767440:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788813422.767447:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313417088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813422.767489:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313417088:12345-0@lo:400:kworker.0 Request processed in 42us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813422.767495:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788813422.767525:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813422.767531:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313417728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813422.767558:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313417728:12345-0@lo:400:kworker.0 Request processed in 28us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813422.767564:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813422.767586:0:23758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313417216 00000100:00100000:0.0:1788813422.767590:0:23758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313417216 00000100:00100000:0.0:1788813422.767614:0:23758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788813422.767620:0:23758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313417216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813422.767650:0:23758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313417216:12345-0@lo:400:kworker.0 Request processed in 30us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813422.767661:0:23758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788813422.767677:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813422.767705:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313417216:0@lo:400:kworker.0 00010000:00080000:0.0:1788813422.767716:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76406680 x1875706313417088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813422.767727:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313417088:0@lo:400:kworker.0 00010000:00080000:0.0:1788813422.767736:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76406300 x1875706313417728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813422.767744:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313417728:0@lo:400:kworker.0 00000100:00100000:3.0:1788813422.767805:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:151fd599-5695-4163-8caa-7faa559323aa:3625:1875706313416832:0@lo:400:kworker.0 00000100:00100000:3.0:1788813422.767844:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813422.767881:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313417472:0@lo:400:kworker.0 00000100:00100000:3.0:1788813422.767903:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813422.767918:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788813422.767923:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313416960:0@lo:400:kworker.0 00000100:00100000:3.0:1788813422.767971:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813422.767987:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313417600:0@lo:400:kworker.0 00000100:00100000:3.0:1788813422.768010:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813422.768031:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313417472 00000100:00100000:3.0:1788813422.768034:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313417472 00000100:00100000:3.0:1788813422.768051:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313417600 00000100:00100000:3.0:1788813422.768054:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313417600 00000100:00100000:3.0:1788813422.768072:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788813422.768079:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313417472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813422.768114:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313417472:12345-0@lo:400:kworker.0 Request processed in 35us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813422.768120:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788813422.768133:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813422.768139:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313417600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813422.768163:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313417600:12345-0@lo:400:kworker.0 Request processed in 25us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813422.768169:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788813422.768193:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76404000 x1875706313417600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813422.768203:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313417600:0@lo:400:kworker.0 00010000:00080000:3.0:1788813422.768223:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76406a00 x1875706313417472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813422.768232:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313417472:0@lo:400:kworker.0 00000100:00100000:3.0:1788813422.768249:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313417344:0@lo:8:kworker.0 00000100:00100000:3.0:1788813422.768276:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813422.770376:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313416832 00000100:00100000:0.0:1788813422.770387:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313416832 00000100:00100000:0.0:1788813422.770444:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788813422.770454:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a4a623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+21:3625:x1875706313416832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813422.770547:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a4a623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+21:3625:x1875706313416832:12345-0@lo:400:kworker.0 Request processed in 95us (2702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813422.770554:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788813422.770598:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313417344 00000100:00100000:0.0:1788813422.770601:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313417344 00000100:00100000:0.0:1788813422.770618:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813422.770623:0:24228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1875706313417344:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788813422.770648:0:24228:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:0.0:1788813422.770673:0:24228:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff7046f1 00002000:00100000:0.0:1788813422.770686:0:24228:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff948a6fbd2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788813422.770691:0:24228:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788813422.770699:0:24228:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788813422.770864:0:24228:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788813422.770893:0:24228:0:(import.c:65:import_set_state_nolock()) ffff948a6fbd5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813422.770960:0:24228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1875706313417344:12345-0@lo:8:kworker.0 Request processed in 335us (2683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813422.770966:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813422.771005:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:151fd599-5695-4163-8caa-7faa559323aa:3625:1875706313416832:0@lo:400:kworker.0 00000100:00080000:0.0:1788813422.771031:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788813422.771246:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76406d80 x1875706313417344/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813422.771256:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788813422.771263:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788813422.771272:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788813422.771277:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788813422.771279:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a74aa7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788813422.771290:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788813422.771295:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313417344:0@lo:8:kworker.0 00000100:00100000:2.0:1788813422.773214:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313416960 00000100:00100000:2.0:1788813422.773228:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313416960 00000100:00100000:2.0:1788813422.773287:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788813422.773297:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313416960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813422.773394:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313416960:12345-0@lo:400:kworker.0 Request processed in 99us (5422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813422.773401:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788813422.773443:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313416960:0@lo:400:kworker.0 00000004:00080000:0.0:1788813422.773670:0:23465:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788813422.773697:0:23465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23465:1875706313417984:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788813422.773739:0:23465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813422.773760:0:23465:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a74a5a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813422.773847:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813422.773856:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313417856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813422.773883:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813422.773953:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313417856 00000100:00100000:0.0:1788813422.773958:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313417856 00000100:00100000:0.0:1788813422.774005:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813422.774013:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3627:x1875706313417856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788813422.774033:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788813422.774082:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3627:x1875706313417856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813422.774088:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788813422.774106:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813422.774125:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76405f80 x1875706313417856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813422.774140:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313417856:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1788813422.782095:0:23464:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788813422.782193:0:23464:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 575801260467ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788813422.782202:0:23464:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788813422.782251:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313417984 00000100:00100000:1.0:1788813422.782261:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313417984 00000100:00100000:1.0:1788813422.782320:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813422.782330:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23465:x1875706313417984:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788813422.784823:0:23456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1788813422.789691:0:24231:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788813422.789700:0:24231:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788813422.789795:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23465:x1875706313417984:12345-0@lo:7:osp-pre-0-1.0 Request processed in 7462us (16050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813422.789816:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788813422.790648:0:23465:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76406300 x1875706313417984/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788813438 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813422.790665:0:23465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23465:1875706313417984:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788813422.790678:0:23465:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788813422.790722:0:23465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46543b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23465:1875706313418112:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788813422.790764:0:23465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813422.790797:0:23465:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a471c3180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813422.792571:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313418112 00000100:00100000:2.0:1788813422.792581:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313418112 00000100:00100000:2.0:1788813422.792643:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813422.792655:0:24230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23465:x1875706313418112:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788813422.792688:0:24230:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1788813422.792766:0:24230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23465:x1875706313418112:12345-0@lo:5:osp-pre-0-1.0 Request processed in 114us (2001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813422.792773:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788813422.792830:0:23465:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a46543b80 x1875706313418112/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813438 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813422.792844:0:23465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46543b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23465:1875706313418112:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788813422.792856:0:23465:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788813422.792896:0:23465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23465:1875706313418240:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788813422.792928:0:23465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813422.792986:0:23465:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a74a5a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813422.796222:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313418240 00000100:00100000:2.0:1788813422.796236:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313418240 00000100:00100000:2.0:1788813422.796306:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813422.796316:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23465:x1875706313418240:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788813422.796364:0:24231:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:1.0:1788813422.868100:0:24225:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1788813422.868116:0:24225:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788813422.873760:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23465:x1875706313418240:12345-0@lo:5:osp-pre-0-1.0 Request processed in 77438us (80822us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788813422.873776:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788813422.873831:0:23465:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76405f80 x1875706313418240/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813438 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813422.873844:0:23465:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788813422.873850:0:23465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23465:1875706313418240:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788813422.873865:0:23465:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1788813422.873917:0:23465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23465:1875706313418368:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788813422.873981:0:23465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813422.874002:0:23465:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813422.874031:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313418368 00000100:00100000:3.0:1788813422.874036:0:22735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313418368 00000100:00100000:3.0:1788813422.874084:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813422.874093:0:22735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23465:x1875706313418368:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788813422.874137:0:22735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23465:x1875706313418368:12345-0@lo:900:osp-pre-0-1.0 Request processed in 45us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813422.874144:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788813422.874174:0:23465:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6eda5880 x1875706313418368/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788813438 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813422.874184:0:23465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23465:1875706313418368:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1788813423.525132:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813423.788745:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813408/real 1788813408] req@ffff948943124e00 x1875706313410304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813423 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813423.788775:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948943124e00 x1875706313410304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813423 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788813423.788796:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948941924000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788813423.788821:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788813423.788825:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313410304:0@lo:8:kworker.0 00000100:00080000:2.0:1788813423.791250:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813423.791256:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813423.791258:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813423.791261:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813423.791290:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813423.791293:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788813423.791296:0:36:0:(import.c:65:import_set_state_nolock()) ffff948941924000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813423.791304:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 561 00000100:00080000:2.0:1788813423.791309:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788813423.791321:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff948941924000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813423.791349:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948943126680 x1875706313419136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813423.791400:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313418624:0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.791461:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813423.791503:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313419264:0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.791529:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813423.791560:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788813423.791567:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313418496:0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.791595:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813423.791618:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313419008:0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.791639:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813423.791664:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313418752:0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.791685:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813423.791702:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313419392:0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.791724:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813423.791740:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788813423.791745:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313418880:0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.791765:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813423.791781:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313419520:0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.791803:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813423.791829:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313418624 00000100:00100000:2.0:1788813423.791837:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313418624 00000100:00100000:2.0:1788813423.791875:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313418880 00000100:00100000:2.0:1788813423.791878:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313418880 00000100:00100000:2.0:1788813423.791893:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788813423.791901:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313418624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.791984:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313418624:12345-0@lo:400:kworker.0 Request processed in 83us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813423.791991:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788813423.792009:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788813423.792015:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313418880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.792044:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313418880:12345-0@lo:400:kworker.0 Request processed in 30us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813423.792049:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788813423.792065:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313419008 00000100:00100000:2.0:1788813423.792070:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313419008 00000100:00100000:2.0:1788813423.792094:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813423.792100:0:24230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313419008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.792128:0:24230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313419008:12345-0@lo:400:kworker.0 Request processed in 29us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813423.792133:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813423.792149:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313419264 00000100:00100000:2.0:1788813423.792152:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313419264 00000100:00100000:2.0:1788813423.792167:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313418752 00000100:00100000:2.0:1788813423.792169:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313418752 00000100:00100000:2.0:1788813423.792178:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313419392 00000100:00100000:2.0:1788813423.792180:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313419392 00000100:00100000:2.0:1788813423.792189:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313419520 00000100:00100000:2.0:1788813423.792191:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313419520 00000100:00100000:2.0:1788813423.792203:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788813423.792208:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313419264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.792237:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313419264:12345-0@lo:400:kworker.0 Request processed in 28us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813423.792242:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788813423.792262:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788813423.792268:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313418752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.792297:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313418752:12345-0@lo:400:kworker.0 Request processed in 29us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813423.792302:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788813423.794120:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313418496 00000100:00100000:1.0:1788813423.794133:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313418496 00000100:00100000:1.0:1788813423.794193:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788813423.794201:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a4a620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+21:3626:x1875706313418496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813423.794265:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a4a620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+21:3626:x1875706313418496:12345-0@lo:400:kworker.0 Request processed in 65us (2668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813423.794271:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788813423.794310:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313419136:0@lo:8:kworker.0 00000100:00100000:1.0:1788813423.794355:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813423.796580:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813423.796605:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313419392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.796692:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313419392:12345-0@lo:400:kworker.0 Request processed in 99us (4965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813423.796954:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788813423.796966:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313419520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813423.797003:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313419520:12345-0@lo:400:kworker.0 Request processed in 42us (5198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813423.797009:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813423.797030:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788813423.797043:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313419136 00000100:00100000:3.0:1788813423.797050:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313419136 00000100:00100000:2.0:1788813423.797086:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313418880:0@lo:400:kworker.0 00000100:00100000:3.0:1788813423.797102:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788813423.797102:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a7ccbe300 x1875706313419520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813423.797107:0:24228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1875706313419136:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788813423.797112:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313419520:0@lo:400:kworker.0 00010000:00080000:2.0:1788813423.797123:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948943126d80 x1875706313418752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00020000:3.0:1788813423.797125:0:24228:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788813423.797130:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313418752:0@lo:400:kworker.0 00010000:00080000:2.0:1788813423.797139:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a7ccbea00 x1875706313419392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813423.797146:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313419392:0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.797181:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313418496:0@lo:400:kworker.0 00010000:00080000:2.0:1788813423.797193:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948943127800 x1875706313419008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813423.797217:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313419008:0@lo:400:kworker.0 00000100:00100000:2.0:1788813423.797229:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313418624:0@lo:400:kworker.0 00010000:00080000:2.0:1788813423.797240:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948943124a80 x1875706313419264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813423.797246:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313419264:0@lo:400:kworker.0 00000020:00000004:0.0:1788813423.834253:0:24647:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788813423.834772:0:24647:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788813423.836388:0:24228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1875706313419136:12345-0@lo:8:kworker.0 Request processed in 39274us (42026us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788813423.836401:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788813423.846226:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948941924000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813423.846238:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813423.846243:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313419136:0@lo:8:kworker.0 00000100:00100000:0.0:1788813423.979757:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313419648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813423.979827:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813423.983574:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313419776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813423.983640:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813423.983694:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313419648 00000100:00100000:3.0:1788813423.983701:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313419648 00000100:00100000:3.0:1788813423.983739:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313419776 00000100:00100000:3.0:1788813423.983741:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313419776 00000100:00100000:3.0:1788813423.983753:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788813423.983760:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313419648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788813423.983792:0:22729:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788813423.989393:0:23758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788813423.989414:0:23758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313419776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813423.989453:0:23758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788813423.989558:0:23758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313419776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (5917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813423.989565:0:23758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788813423.990177:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313419648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6413us (10346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813423.990185:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788813423.990242:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313419776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813423.993105:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313419648:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788813424.549341:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788813424.792407:0:24697:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813424.792728:0:24697:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788813424.870774:0:22759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788813425.574009:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813426.603277:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.620088:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813427.876315:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813407/real 1788813407] req@ffff948943488a80 x1875706313408384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813427 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813427.876369:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948943488a80 x1875706313408384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813427 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813427.876382:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813407/real 1788813407] req@ffff94894348b800 x1875706313408512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813427 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813427.876395:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94894348b800 x1875706313408512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813427 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788813427.876447:0:3624:0:(import.c:65:import_set_state_nolock()) ffff9489437d8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813427.876489:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788813427.876494:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313408384:0@lo:8:kworker.0 00000100:00080000:2.0:1788813427.876501:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b57d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813427.876507:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788813427.876511:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313408512:0@lo:8:kworker.0 00000100:00080000:3.0:1788813427.876655:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813427.876661:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788813427.876664:0:36:0:(import.c:65:import_set_state_nolock()) ffff9489437d8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813427.876671:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 560 00000100:00100000:2.0:1788813427.876671:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313419904:0@lo:400:kworker.0 00000100:00080000:3.0:1788813427.876678:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788813427.876691:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9489437d8800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813427.876714:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a764cb480 x1875706313420160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813427.876739:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813427.876742:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788813427.876751:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a7b57d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813427.876755:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 560 00000100:00080000:3.0:1788813427.876758:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788813427.876764:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948a7b57d800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813427.876764:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813427.876776:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a764c9180 x1875706313420288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813427.876815:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813427.876819:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788813427.876822:0:36:0:(import.c:65:import_set_state_nolock()) ffff948941924000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813427.876825:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 576 00000100:00080000:3.0:1788813427.876828:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:2.0:1788813427.876829:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313420672:0@lo:400:kworker.0 00000100:00080000:3.0:1788813427.876832:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff948941924000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813427.876846:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a764cad80 x1875706313420800/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813427.876858:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813427.876880:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788813427.876886:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313420544:0@lo:400:kworker.0 00000100:00100000:2.0:1788813427.876886:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313420032:0@lo:400:kworker.0 00000100:00100000:2.0:1788813427.876911:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813427.876927:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813427.876954:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313420928:0@lo:400:kworker.0 00000100:00100000:3.0:1788813427.876974:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313421184:0@lo:400:kworker.0 00000100:00100000:2.0:1788813427.876981:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813427.877001:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813427.877014:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313419904 00000100:00100000:3.0:1788813427.877020:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788813427.877024:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313419904 00000100:00100000:3.0:1788813427.877025:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313420416:0@lo:400:kworker.0 00000100:00100000:3.0:1788813427.877045:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813427.877062:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313421056:0@lo:400:kworker.0 00000100:00100000:3.0:1788813427.877082:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813427.877104:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313420032 00000100:00100000:3.0:1788813427.877108:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313420032 00000100:00100000:3.0:1788813427.877172:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313420544 00000100:00100000:3.0:1788813427.877176:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313420544 00000100:00100000:3.0:1788813427.877195:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788813427.877205:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313420032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813427.877268:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313420032:12345-0@lo:400:kworker.0 Request processed in 64us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813427.877276:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788813427.877286:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313420160:0@lo:8:kworker.0 00000100:00100000:3.0:1788813427.877295:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788813427.877301:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313420544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813427.877333:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313420544:12345-0@lo:400:kworker.0 Request processed in 31us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813427.877338:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788813427.877378:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313420544:0@lo:400:kworker.0 00000100:00100000:1.0:1788813427.877388:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813427.877414:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313420288:0@lo:8:kworker.0 00000100:00100000:1.0:1788813427.877441:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813427.877474:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313420800:0@lo:8:kworker.0 00000100:00100000:1.0:1788813427.877495:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813427.877865:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313420672 00000100:00100000:3.0:1788813427.877870:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313420672 00000100:00100000:3.0:1788813427.878220:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313420160 00000100:00100000:3.0:1788813427.878225:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313420160 00000100:00100000:3.0:1788813427.878241:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313420288 00000100:00100000:3.0:1788813427.878244:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313420288 00000100:00100000:3.0:1788813427.878252:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313420800 00000100:00080000:1.0:1788813427.878253:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813427.878254:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313420800 00000100:00100000:3.0:1788813427.878264:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813427.878272:0:24228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313420672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813427.878328:0:24228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313420672:12345-0@lo:400:kworker.0 Request processed in 57us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813427.878335:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813427.878351:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788813427.878356:0:24228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1875706313420160:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788813427.878400:0:24228:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 580 last 0 00000100:00100000:2.0:1788813427.878691:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788813427.878701:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+21:3627:x1875706313419904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813427.878740:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+21:3627:x1875706313419904:12345-0@lo:400:kworker.0 Request processed in 42us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813427.878758:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788813427.878804:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313420928 00000100:00100000:2.0:1788813427.878809:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313420928 00000100:00100000:2.0:1788813427.878836:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313421184 00000100:00100000:2.0:1788813427.878840:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313421184 00000100:00100000:2.0:1788813427.878862:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313420416 00000100:00100000:2.0:1788813427.878866:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313420416 00000100:00100000:2.0:1788813427.878875:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313421056 00000100:00100000:2.0:1788813427.878877:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313421056 00000100:00100000:2.0:1788813427.878890:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813427.878896:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313420928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813427.878958:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313420928:12345-0@lo:400:kworker.0 Request processed in 62us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813427.878965:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813427.878976:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813427.878983:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313421184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813427.879017:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313421184:12345-0@lo:400:kworker.0 Request processed in 35us (2014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813427.879022:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813427.879033:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000020:00000080:3.0:1788813427.879603:0:24228:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff7046f8 00002000:00100000:3.0:1788813427.879625:0:24228:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff948a6e64c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1788813427.880001:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313420416:12345-0@lo:400:kworker.0 00002000:00080000:3.0:1788813427.880393:0:24228:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788813427.880399:0:24228:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788813427.880445:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313420416:12345-0@lo:400:kworker.0 Request processed in 1403us (3395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813427.880465:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788813427.880493:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788813427.880506:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313421056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813427.880541:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313421056:12345-0@lo:400:kworker.0 Request processed in 40us (3457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813427.880547:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788813427.880590:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813427.880608:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788813427.880653:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a764c8a80 x1875706313420416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813427.880670:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313420416:0@lo:400:kworker.0 00010000:00080000:2.0:1788813427.880685:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a764c8700 x1875706313421056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813427.880693:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313421056:0@lo:400:kworker.0 00010000:00080000:2.0:1788813427.880706:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a764ca300 x1875706313421184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813427.880714:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313421184:0@lo:400:kworker.0 00000100:00100000:2.0:1788813427.880768:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313420032:0@lo:400:kworker.0 00010000:00080000:2.0:1788813427.880781:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a764c9f80 x1875706313420928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813427.880789:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313420928:0@lo:400:kworker.0 00010000:00080000:2.0:1788813427.880801:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a764c8000 x1875706313420672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813427.880808:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313420672:0@lo:400:kworker.0 00000100:00100000:2.0:1788813427.880818:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313419904:0@lo:400:kworker.0 00002000:00080000:3.0:1788813427.881129:0:24228:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788813427.882147:0:24228:0:(import.c:65:import_set_state_nolock()) ffff948a6e64a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813427.883806:0:24228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1875706313420160:12345-0@lo:8:kworker.0 Request processed in 4274us (5243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813427.883823:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788813427.883882:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813427.883889:0:24228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1875706313420288:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788813427.883899:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a764cb480 x1875706313420160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813427.883912:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00020000:3.0:1788813427.883915:0:24228:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788813427.883922:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788813427.883949:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788813427.883956:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788813427.883960:0:3624:0:(import.c:65:import_set_state_nolock()) ffff9489437d8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788813427.883996:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788813427.884004:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313420160:0@lo:8:kworker.0 00000004:00080000:0.0:1788813427.884880:0:22747:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788813427.885219:0:22747:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 580904285700ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788813427.885230:0:22747:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788813427.885465:0:22748:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:2.0:1788813427.885503:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22748:1875706313421440:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788813427.885581:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813427.885615:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a459393c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813427.885658:0:24230:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788813427.885667:0:24230:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788813427.885962:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313421312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813427.886001:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813427.886584:0:24228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1875706313420288:12345-0@lo:8:kworker.0 Request processed in 2691us (9139us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813427.886597:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788813427.886618:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b57d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788813427.886626:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313421440 00000100:00080000:1.0:1788813427.886630:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813427.886633:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313421440 00000100:00100000:1.0:1788813427.886634:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313420288:0@lo:8:kworker.0 00000100:00100000:3.0:1788813427.886701:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813427.886709:0:24228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1875706313420800:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788813427.886737:0:24228:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788813427.886774:0:24228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1875706313420800:12345-0@lo:8:kworker.0 Request processed in 64us (9278us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813427.886781:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813427.886792:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813427.886805:0:24228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22748:x1875706313421440:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1788813427.887073:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813427.887076:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313421312 00000100:00100000:0.0:1788813427.887081:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313421312 00000100:00080000:3.0:1788813427.887096:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948941924000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813427.887100:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813427.887104:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313420800:0@lo:8:kworker.0 00000100:00100000:0.0:1788813427.887825:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813427.887853:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1875706313421312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813427.887887:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788813427.887997:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1875706313421312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (1994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813427.888018:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788813427.889444:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a7ccbd180 x1875706313421312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813427.889489:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313421312:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788813427.896282:0:22703:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788813427.896310:0:24228:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788813427.896322:0:24228:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1788813427.896332:0:24228:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00010000:2.0:1788813427.925715:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813427.925730:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7b73d8f/0xf32533d6ff7046ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813427.925821:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=580s v=(0 0) 00010000:00010000:2.0:1788813427.925827:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813427.925835:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7b73d8f/0xf32533d6ff7046ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813427.925858:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7b73d8f/0xf32533d6ff7046ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813427.925871:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7b73d8f/0xf32533d6ff7046ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813427.925880:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7b73d8f/0xf32533d6ff7046ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813427.925914:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813427.928815:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813427.928830:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7b73d8f/0xf32533d6ff7046ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.928846:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a80a00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.928852:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7b73d8f/0xf32533d6ff7046ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.928865:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7b73d8f/0xf32533d6ff7046ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.928898:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7b73d8f/0xf32533d6ff7046ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.928906:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7b73d8f/0xf32533d6ff7046ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.928967:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.928969:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.928971:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813427.934131:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813427.934163:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704706 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.934186:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=580s v=(0 0) 00010000:00010000:3.0:1788813427.934191:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813427.934199:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704706 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.934219:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704706 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.934232:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704706 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.934263:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704706 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.934291:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813427.934696:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813427.934706:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704706 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813427.934715:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813427.934721:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704706 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813427.934744:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704706 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813427.934777:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704706 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813427.934786:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704706 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813427.934813:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813427.934815:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813427.934817:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813427.935261:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813427.935268:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b908b739/0xf32533d6ff70470d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.935280:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=580s v=(0 0) 00010000:00010000:3.0:1788813427.935284:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813427.935289:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b908b739/0xf32533d6ff70470d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.935300:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b908b739/0xf32533d6ff70470d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.935309:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b908b739/0xf32533d6ff70470d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.935317:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b908b739/0xf32533d6ff70470d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.935340:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813427.935539:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813427.935547:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b908b739/0xf32533d6ff70470d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.935568:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.935572:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b908b739/0xf32533d6ff70470d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.935582:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b908b739/0xf32533d6ff70470d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.935596:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b908b739/0xf32533d6ff70470d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.935604:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b908b739/0xf32533d6ff70470d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.935622:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.935624:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.935626:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813427.935825:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813427.935830:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704714 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.935845:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=580s v=(0 0) 00010000:00010000:3.0:1788813427.935848:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813427.935853:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704714 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.935863:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704714 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.935872:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704714 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.935879:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704714 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.935966:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788813427.936848:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813427.936858:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70471b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.936871:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=580s v=(0 0) 00010000:00010000:3.0:1788813427.936875:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813427.936881:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70471b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.936892:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70471b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.936915:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70471b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.936922:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70471b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.945146:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813427.945281:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704714 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.945298:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.945304:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704714 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.945317:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704714 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.945371:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704714 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.945380:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704714 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.945410:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813427.945415:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70471b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.945422:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.945425:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70471b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.945433:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70471b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.945442:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70471b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.945449:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.945451:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.945452:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813427.947288:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788813427.947322:0:24228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70471b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.948182:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813427.949097:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813427.949112:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff704722 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.949131:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=580s v=(0 0) 00010000:00010000:3.0:1788813427.949137:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813427.949145:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff704722 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.949164:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff704722 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.949177:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff704722 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.949205:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff704722 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.949226:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813427.949298:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813427.949308:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff704722 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.949323:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4c00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.949328:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff704722 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.949338:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff704722 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.949359:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff704722 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.949366:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff704722 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.949388:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.949390:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.949392:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813427.951391:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813427.951596:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704729 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.951620:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=580s v=(0 0) 00010000:00010000:3.0:1788813427.951625:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813427.951750:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704729 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.951771:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704729 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.951782:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704729 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.951791:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704729 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.951815:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813427.952294:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813427.952303:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704729 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.952313:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813427.952318:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704729 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.952330:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704729 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.952355:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704729 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.952364:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704729 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.952390:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813427.952392:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813427.952394:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813427.952919:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813427.952927:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2498049/0xf32533d6ff704730 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.952968:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=580s v=(0 0) 00010000:00010000:3.0:1788813427.952972:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813427.952977:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2498049/0xf32533d6ff704730 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.952989:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2498049/0xf32533d6ff704730 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.952996:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2498049/0xf32533d6ff704730 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.953004:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2498049/0xf32533d6ff704730 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.953023:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813427.953884:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813427.953895:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2498049/0xf32533d6ff704730 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.953906:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.953911:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2498049/0xf32533d6ff704730 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.953921:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2498049/0xf32533d6ff704730 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.953976:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2498049/0xf32533d6ff704730 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.953984:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2498049/0xf32533d6ff704730 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.954010:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.954012:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.954014:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813427.954915:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813427.954928:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704737 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.954959:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=580s v=(0 0) 00010000:00010000:3.0:1788813427.954964:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813427.954972:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704737 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.954986:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704737 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.955014:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704737 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.955023:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704737 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.955062:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813427.955883:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813427.955894:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704737 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.955905:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.955910:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704737 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.955919:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704737 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.955963:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704737 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.955972:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fba7a58/0xf32533d6ff704737 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.956020:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.956023:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.956025:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813427.963230:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813427.963251:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70473e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.963274:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=580s v=(0 0) 00010000:00010000:3.0:1788813427.963280:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813427.963288:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70473e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.963316:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70473e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.963329:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70473e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.963338:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70473e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.963379:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788813427.964227:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813427.964235:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704745 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.964248:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=580s v=(0 0) 00010000:00010000:3.0:1788813427.964252:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813427.964257:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.964269:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.964278:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.964287:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704745 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.964373:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788813427.964506:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813427.964516:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70473e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.964526:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.964532:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70473e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.964543:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70473e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.964564:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70473e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.964572:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff70473e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.964594:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813427.964598:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704745 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.964605:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.964614:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704745 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.964623:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704745 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.964634:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704745 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.964641:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039aad36a/0xf32533d6ff704745 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.964655:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.964657:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.964659:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813427.965204:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813427.965212:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff70474c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.965224:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=580s v=(0 0) 00010000:00010000:3.0:1788813427.965235:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813427.965241:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff70474c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.965252:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff70474c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.965261:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff70474c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.965268:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff70474c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.965287:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813427.965382:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813427.965390:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff70474c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.965397:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4c00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813427.965400:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff70474c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.965418:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff70474c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.965431:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff70474c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.965438:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5cf116f/0xf32533d6ff70474c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.965466:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813427.965468:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813427.965470:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.966268:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813427.967516:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813427.967531:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704753 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.967550:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=580s v=(0 0) 00010000:00010000:3.0:1788813427.967554:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813427.967560:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704753 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.967575:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704753 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.967585:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704753 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.967603:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704753 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813427.967847:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813427.974411:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813427.974431:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff70475a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.974462:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=580s v=(0 0) 00010000:00010000:0.0:1788813427.974469:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813427.974476:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff70475a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.974494:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff70475a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.974506:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff70475a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.974532:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff70475a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.975061:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813427.975072:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704753 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.975082:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.975087:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704753 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.975099:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704753 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.975123:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704753 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.975143:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704753 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.975170:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813427.975173:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff70475a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.975180:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdba00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.975183:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff70475a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.975190:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff70475a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.975201:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff70475a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.975209:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.975210:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.975212:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.983927:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813427.983927:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788813427.983966:0:24228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff70475a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813427.985025:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813427.985037:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e64e1e8d/0xf32533d6ff704761 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813427.985056:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=581s v=(0 0) 00010000:00010000:2.0:1788813427.985061:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813427.985069:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e64e1e8d/0xf32533d6ff704761 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813427.985090:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e64e1e8d/0xf32533d6ff704761 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813427.985101:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e64e1e8d/0xf32533d6ff704761 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813427.985119:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e64e1e8d/0xf32533d6ff704761 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813427.985140:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813427.985346:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813427.985355:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e64e1e8d/0xf32533d6ff704761 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.985365:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a81e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.985378:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e64e1e8d/0xf32533d6ff704761 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.985390:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e64e1e8d/0xf32533d6ff704761 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.985419:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e64e1e8d/0xf32533d6ff704761 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.985428:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e64e1e8d/0xf32533d6ff704761 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.985448:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.985450:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.985452:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813427.986125:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813427.986134:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3c3d57/0xf32533d6ff704768 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.986145:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=581s v=(0 0) 00010000:00010000:0.0:1788813427.986149:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813427.986154:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c3c3d57/0xf32533d6ff704768 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.986167:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c3c3d57/0xf32533d6ff704768 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.986176:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3c3d57/0xf32533d6ff704768 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.986183:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c3c3d57/0xf32533d6ff704768 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.986218:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813427.987803:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813427.987819:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c3c3d57/0xf32533d6ff704768 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.987834:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb800 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.987839:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3c3d57/0xf32533d6ff704768 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.987851:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3c3d57/0xf32533d6ff704768 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.987874:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c3c3d57/0xf32533d6ff704768 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.987900:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c3c3d57/0xf32533d6ff704768 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.987927:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.987971:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.987974:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813427.988276:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813427.988284:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000678b3d8/0xf32533d6ff70476f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.988297:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=581s v=(0 0) 00010000:00010000:0.0:1788813427.988302:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813427.988312:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000678b3d8/0xf32533d6ff70476f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.988325:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000678b3d8/0xf32533d6ff70476f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.988334:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000678b3d8/0xf32533d6ff70476f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.988341:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000678b3d8/0xf32533d6ff70476f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.988365:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813427.988634:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813427.988641:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000678b3d8/0xf32533d6ff70476f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.988649:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.988653:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000678b3d8/0xf32533d6ff70476f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.988662:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000678b3d8/0xf32533d6ff70476f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.988673:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000678b3d8/0xf32533d6ff70476f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.988680:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000678b3d8/0xf32533d6ff70476f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.988697:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.988698:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.988700:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813427.989442:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813427.989452:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff704776 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.989475:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=581s v=(0 0) 00010000:00010000:0.0:1788813427.989488:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813427.989493:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff704776 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.989505:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff704776 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.989515:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff704776 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.989523:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff704776 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.989579:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813427.990004:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813427.990011:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff70477d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.990022:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=581s v=(0 0) 00010000:00010000:0.0:1788813427.990026:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813427.990030:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff70477d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.990042:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff70477d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.990051:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff70477d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813427.990067:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff70477d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.995633:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813427.995654:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff704776 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.995674:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdba00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.995680:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff704776 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.995695:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff704776 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.995726:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff704776 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.995735:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e86d555/0xf32533d6ff704776 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.995784:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813427.995788:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff70477d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.995795:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdae00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813427.995798:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff70477d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.995807:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff70477d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.995841:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff70477d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813427.995850:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.995852:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813427.995854:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.000700:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788813428.000719:0:24228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff70477d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.000885:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813428.002900:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813428.002920:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff704784 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.004611:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=581s v=(0 0) 00010000:00010000:0.0:1788813428.004618:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813428.004628:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff704784 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.004650:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff704784 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.004663:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff704784 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.004672:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff704784 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.008298:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813428.009183:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813428.009197:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff704784 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.009214:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813428.009220:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff704784 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.009233:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff704784 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.009260:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff704784 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.009269:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff704784 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.009293:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.009295:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.009297:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813428.009562:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813428.009570:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d05aba/0xf32533d6ff70478b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.009585:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1788813428.009590:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813428.009597:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d05aba/0xf32533d6ff70478b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.009611:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7d05aba/0xf32533d6ff70478b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.009620:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d05aba/0xf32533d6ff70478b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.009626:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d05aba/0xf32533d6ff70478b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.009671:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788813428.010239:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813428.010246:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eaaf884/0xf32533d6ff704792 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.010256:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1788813428.010258:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813428.010262:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eaaf884/0xf32533d6ff704792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.010271:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eaaf884/0xf32533d6ff704792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.010279:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eaaf884/0xf32533d6ff704792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.010286:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eaaf884/0xf32533d6ff704792 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.010308:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788813428.010561:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788813428.010571:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7d05aba/0xf32533d6ff70478b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813428.010580:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9a00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813428.010584:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d05aba/0xf32533d6ff70478b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813428.010593:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d05aba/0xf32533d6ff70478b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813428.010609:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7d05aba/0xf32533d6ff70478b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813428.010616:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7d05aba/0xf32533d6ff70478b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813428.010646:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813428.010650:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eaaf884/0xf32533d6ff704792 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813428.010670:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9c00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813428.010674:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eaaf884/0xf32533d6ff704792 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813428.010682:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eaaf884/0xf32533d6ff704792 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813428.010692:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eaaf884/0xf32533d6ff704792 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813428.010700:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eaaf884/0xf32533d6ff704792 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813428.010713:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813428.010714:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813428.010716:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813428.011017:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813428.011024:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068b2eed3/0xf32533d6ff704799 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.011033:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1788813428.011289:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813428.011295:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068b2eed3/0xf32533d6ff704799 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.011308:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068b2eed3/0xf32533d6ff704799 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.011317:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068b2eed3/0xf32533d6ff704799 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.011324:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068b2eed3/0xf32533d6ff704799 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.011349:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813428.011431:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813428.011439:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068b2eed3/0xf32533d6ff704799 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813428.011447:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813428.011450:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068b2eed3/0xf32533d6ff704799 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813428.011468:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068b2eed3/0xf32533d6ff704799 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813428.011483:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068b2eed3/0xf32533d6ff704799 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813428.011490:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068b2eed3/0xf32533d6ff704799 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813428.011507:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813428.011509:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813428.011510:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.011571:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813428.012069:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813428.012076:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a000737a/0xf32533d6ff7047a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.012089:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1788813428.012093:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813428.012098:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a000737a/0xf32533d6ff7047a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.012110:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a000737a/0xf32533d6ff7047a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.012120:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a000737a/0xf32533d6ff7047a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.012136:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a000737a/0xf32533d6ff7047a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.012168:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788813428.012545:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813428.012551:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ae5e7dd/0xf32533d6ff7047a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.012560:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1788813428.012564:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813428.012568:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ae5e7dd/0xf32533d6ff7047a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.012578:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ae5e7dd/0xf32533d6ff7047a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.012587:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ae5e7dd/0xf32533d6ff7047a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.012595:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ae5e7dd/0xf32533d6ff7047a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.012618:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788813428.012838:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813428.012847:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a000737a/0xf32533d6ff7047a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.012857:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9800 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813428.012868:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a000737a/0xf32533d6ff7047a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.012878:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a000737a/0xf32533d6ff7047a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.012893:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a000737a/0xf32533d6ff7047a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.012901:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a000737a/0xf32533d6ff7047a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.012921:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813428.012924:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ae5e7dd/0xf32533d6ff7047a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.012930:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813428.012964:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ae5e7dd/0xf32533d6ff7047a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.012973:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ae5e7dd/0xf32533d6ff7047a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.012984:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ae5e7dd/0xf32533d6ff7047a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.012992:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ae5e7dd/0xf32533d6ff7047a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.013013:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.013015:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.013017:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813428.013018:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813428.013026:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff7047ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.013043:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1788813428.013046:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813428.013051:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff7047ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.013062:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff7047ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.013071:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff7047ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.013078:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff7047ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.013098:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813428.013178:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813428.013184:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff7047ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.013192:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813428.013196:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff7047ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.013204:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff7047ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.013215:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff7047ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.013223:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff7047ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.013237:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.013238:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.013240:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813428.013611:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813428.013618:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff7047b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.013627:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1788813428.013630:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813428.013635:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff7047b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.013646:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff7047b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.013668:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff7047b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.013677:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff7047b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.013698:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813428.013827:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813428.013833:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff7047b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.013853:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813428.013857:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff7047b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.013867:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff7047b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.013880:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff7047b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.013888:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff7047b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.013903:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.013904:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.013906:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813428.014236:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813428.014244:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d31b543c/0xf32533d6ff7047bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.014253:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1788813428.014256:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813428.014261:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d31b543c/0xf32533d6ff7047bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.014272:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d31b543c/0xf32533d6ff7047bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.014281:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d31b543c/0xf32533d6ff7047bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.014289:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d31b543c/0xf32533d6ff7047bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.014321:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813428.014383:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813428.014390:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d31b543c/0xf32533d6ff7047bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.014399:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813428.014403:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d31b543c/0xf32533d6ff7047bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.014412:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d31b543c/0xf32533d6ff7047bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.014431:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d31b543c/0xf32533d6ff7047bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.014440:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d31b543c/0xf32533d6ff7047bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.014466:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.014468:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.014469:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813428.015311:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813428.015322:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c6eb49f/0xf32533d6ff7047c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.015335:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1788813428.015339:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813428.015343:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c6eb49f/0xf32533d6ff7047c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.015354:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c6eb49f/0xf32533d6ff7047c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.015362:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c6eb49f/0xf32533d6ff7047c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.015369:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c6eb49f/0xf32533d6ff7047c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.015393:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813428.015499:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813428.015506:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c6eb49f/0xf32533d6ff7047c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.015516:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dade00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813428.015521:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c6eb49f/0xf32533d6ff7047c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.015530:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c6eb49f/0xf32533d6ff7047c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.015545:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c6eb49f/0xf32533d6ff7047c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.015552:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c6eb49f/0xf32533d6ff7047c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.015586:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.015588:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.015590:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813428.017064:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813428.017079:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008ac14d0/0xf32533d6ff7047ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.017097:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1788813428.017114:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813428.017120:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008ac14d0/0xf32533d6ff7047ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.017135:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008ac14d0/0xf32533d6ff7047ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.017146:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008ac14d0/0xf32533d6ff7047ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.017164:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008ac14d0/0xf32533d6ff7047ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.017191:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813428.017214:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813428.017223:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008ac14d0/0xf32533d6ff7047ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.017233:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813428.017239:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008ac14d0/0xf32533d6ff7047ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.017250:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008ac14d0/0xf32533d6ff7047ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.017269:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008ac14d0/0xf32533d6ff7047ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.017277:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008ac14d0/0xf32533d6ff7047ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.017305:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.017307:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.017309:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813428.017785:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813428.017792:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a058c351/0xf32533d6ff7047d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.017803:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=581s v=(0 0) 00010000:00010000:1.0:1788813428.017807:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813428.017812:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a058c351/0xf32533d6ff7047d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.017823:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a058c351/0xf32533d6ff7047d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.017833:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a058c351/0xf32533d6ff7047d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.017848:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a058c351/0xf32533d6ff7047d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813428.017883:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788813428.017922:0:24228:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:1.0:1788813428.018100:0:24228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22748:x1875706313421440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 131290us (132514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813428.018111:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788813428.018120:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813428.018128:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a058c351/0xf32533d6ff7047d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.018150:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813428.018154:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a058c351/0xf32533d6ff7047d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.018164:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a058c351/0xf32533d6ff7047d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.018179:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a058c351/0xf32533d6ff7047d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813428.018187:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a058c351/0xf32533d6ff7047d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813428.018203:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22748:1875706313421440:0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1788813428.018206:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.018211:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813428.018213:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788813428.018229:0:22748:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:1.0:1788813428.018294:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46540e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22748:1875706313421568:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788813428.018338:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813428.018378:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894238c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813428.018401:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313421568 00000100:00100000:1.0:1788813428.018409:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313421568 00010000:00010000:3.0:1788813428.019650:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813428.021651:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813428.021668:0:24228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22748:x1875706313421568:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788813428.026689:0:24228:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:3.0:1788813428.047512:0:24225:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1788813428.047575:0:24225:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788813428.048511:0:22748:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788813428.048514:0:24228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22748:x1875706313421568:12345-0@lo:5:osp-pre-0-0.0 Request processed in 26840us (30166us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788813428.048523:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46540e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22748:1875706313421568:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788813428.048532:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000004:00080000:1.0:1788813428.048543:0:22748:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:1.0:1788813428.074360:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813428.074393:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313421696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813428.074519:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813428.074591:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313421696 00000100:00100000:1.0:1788813428.074602:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313421696 00000100:00100000:1.0:1788813428.074666:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813428.074677:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313421696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788813428.074708:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788813428.074772:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313421696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813428.074780:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813428.074842:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313421696:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788813428.656367:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813429.093092:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813429.093117:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313421824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813429.093202:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813429.093250:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313421824 00000100:00100000:3.0:1788813429.093259:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313421824 00000100:00100000:3.0:1788813429.093308:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788813429.093318:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313421824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788813429.093354:0:22729:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788813429.093416:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313421824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813429.093423:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788813429.093481:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313421824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813429.097703:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813429.097736:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313421952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813429.097800:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813429.097849:0:23758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313421952 00000100:00100000:3.0:1788813429.097856:0:23758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313421952 00000100:00100000:3.0:1788813429.097902:0:23758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788813429.097910:0:23758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313421952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788813429.097958:0:23758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788813429.098002:0:23758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313421952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813429.098008:0:23758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788813429.098050:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313421952:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788813429.671557:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813430.693982:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813430.820602:0:23477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788813431.716239:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813432.750209:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788813433.188156:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813433.188164:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788813433.188168:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a7b57d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813433.188177:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 580 00000100:00080000:3.0:1788813433.188182:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788813433.188196:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948a7b57d800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813433.188216:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a764cb480 x1875706313422464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813433.188249:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813433.188252:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788813433.188254:0:36:0:(import.c:65:import_set_state_nolock()) ffff948941924000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813433.188257:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 580 00000100:00080000:3.0:1788813433.188259:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788813433.188262:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff948941924000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813433.188272:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a764c8e00 x1875706313422976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788813433.188315:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313422336:0@lo:400:kworker.0 00000100:00100000:0.0:1788813433.188565:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313422080:0@lo:400:kworker.0 00000100:00100000:1.0:1788813433.188718:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313422592:0@lo:400:kworker.0 00000100:00100000:2.0:1788813433.188777:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313422208:0@lo:400:kworker.0 00000100:00100000:0.0:1788813433.196234:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813433.196303:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313422720:0@lo:400:kworker.0 00000100:00100000:0.0:1788813433.196346:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813433.196417:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313423360:0@lo:400:kworker.0 00000100:00100000:0.0:1788813433.196446:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813433.196494:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313422080 00000100:00100000:0.0:1788813433.196501:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313422080 00000100:00100000:0.0:1788813433.196655:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788813433.196667:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+21:3627:x1875706313422080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813433.196722:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+21:3627:x1875706313422080:12345-0@lo:400:kworker.0 Request processed in 57us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813433.196729:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788813433.196761:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313423360 00000100:00100000:0.0:1788813433.196765:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313423360 00000100:00100000:0.0:1788813433.196803:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788813433.196810:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313423360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813433.196841:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313423360:12345-0@lo:400:kworker.0 Request processed in 32us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813433.196846:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788813433.196864:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813433.196895:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313422080:0@lo:400:kworker.0 00010000:00080000:0.0:1788813433.196910:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a764c8a80 x1875706313423360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813433.196921:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313423360:0@lo:400:kworker.0 00000100:00100000:0.0:1788813433.200117:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313422720 00000100:00100000:0.0:1788813433.200135:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313422720 00000100:00100000:0.0:1788813433.200207:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788813433.200218:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313422720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813433.200317:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313422720:12345-0@lo:400:kworker.0 Request processed in 101us (3970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813433.200338:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788813433.200384:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313422464:0@lo:8:kworker.0 00000100:00100000:0.0:1788813433.200431:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813433.200457:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313422976:0@lo:8:kworker.0 00000100:00100000:0.0:1788813433.200482:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813433.200513:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313422464 00000100:00100000:0.0:1788813433.200518:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313422464 00000100:00100000:0.0:1788813433.200536:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313422976 00000100:00100000:0.0:1788813433.200538:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313422976 00000100:00100000:1.0:1788813433.201497:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813433.201505:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3624:x1875706313422464:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788813433.201532:0:24231:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788813433.201600:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3624:x1875706313422464:12345-0@lo:8:kworker.0 Request processed in 93us (1168us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788813433.201606:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813433.201624:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813433.201629:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3624:x1875706313422976:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788813433.201638:0:24231:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788813433.201659:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3624:x1875706313422976:12345-0@lo:8:kworker.0 Request processed in 30us (1177us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788813433.201677:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788813433.201788:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b57d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788813433.201793:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788813433.201797:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313422464:0@lo:8:kworker.0 00000100:00080000:1.0:1788813433.201806:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948941924000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788813433.201808:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788813433.201811:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313422976:0@lo:8:kworker.0 00000100:00100000:1.0:1788813433.201849:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813433.201887:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313423232:0@lo:400:kworker.0 00000100:00100000:1.0:1788813433.201915:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813433.201952:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313422592 00000100:00100000:1.0:1788813433.201957:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313422592 00000100:00100000:1.0:1788813433.202003:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313423232 00000100:00100000:1.0:1788813433.202007:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313423232 00000100:00100000:1.0:1788813433.202033:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788813433.202039:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313422592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813433.202077:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313422592:12345-0@lo:400:kworker.0 Request processed in 38us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813433.202083:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788813433.202097:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788813433.202103:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313423232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813433.202130:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313423232:12345-0@lo:400:kworker.0 Request processed in 27us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813433.202136:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788813433.202153:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788813433.202178:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a764c8700 x1875706313423232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813433.202190:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313423232:0@lo:400:kworker.0 00010000:00080000:1.0:1788813433.202210:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a764cb800 x1875706313422592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813433.202219:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313422592:0@lo:400:kworker.0 00000100:00100000:1.0:1788813433.202228:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813433.202234:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313423616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813433.202258:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813433.202280:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313423616 00000100:00100000:1.0:1788813433.202284:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313423616 00000100:00100000:1.0:1788813433.202310:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813433.202316:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313423616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788813433.202337:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788813433.202378:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313423616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813433.202384:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788813433.202399:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813433.202430:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313423616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813433.202481:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313422720:0@lo:400:kworker.0 00000100:00100000:2.0:1788813433.206102:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813433.206152:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313422848:0@lo:400:kworker.0 00000100:00100000:2.0:1788813433.206193:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813433.206222:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313423488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813433.206247:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813433.206280:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313423488 00000100:00100000:2.0:1788813433.206288:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313423488 00000100:00100000:2.0:1788813433.206349:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788813433.206388:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313423488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813433.206422:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788813433.206459:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313423488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813433.206465:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788813433.206489:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813433.206523:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313423488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813433.206711:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313422208 00000100:00100000:0.0:1788813433.206716:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313422208 00000100:00100000:0.0:1788813433.206746:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788813433.206752:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313422208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813433.206792:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313422208:12345-0@lo:400:kworker.0 Request processed in 40us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813433.206799:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788813433.206883:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313422848 00000100:00100000:1.0:1788813433.206888:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313422848 00000100:00100000:1.0:1788813433.206927:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813433.206953:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313422848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813433.206986:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313422848:12345-0@lo:400:kworker.0 Request processed in 54us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813433.207013:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813433.207677:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313422208:0@lo:400:kworker.0 00000100:00100000:2.0:1788813433.207690:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313422848:0@lo:400:kworker.0 00000100:00100000:3.0:1788813433.207889:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813433.207948:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313423104:0@lo:400:kworker.0 00000100:00100000:3.0:1788813433.207980:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813433.209481:0:24816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313422336 00000100:00100000:1.0:1788813433.209492:0:24816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313422336 00000100:00100000:1.0:1788813433.209542:0:24816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813433.209565:0:24816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313422336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813433.209645:0:24816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313422336:12345-0@lo:400:kworker.0 Request processed in 82us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813433.209653:0:24816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813433.209921:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313422336:0@lo:400:kworker.0 00000100:00100000:2.0:1788813433.210262:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313423104 00000100:00100000:2.0:1788813433.210268:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313423104 00000100:00100000:2.0:1788813433.210307:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788813433.210315:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313423104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813433.210510:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313423104:12345-0@lo:400:kworker.0 Request processed in 195us (2528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813433.210518:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788813433.212129:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a764ca300 x1875706313423104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813433.212146:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313423104:0@lo:400:kworker.0 00010000:00010000:1.0:1788813433.770209:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788813433.839793:0:25044:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788813433.839798:0:25044:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788813433.839799:0:25044:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788813433.839907:0:25044:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff948a7d688800 00000020:01000004:2.0:1788813433.839923:0:25044:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788813433.840203:0:25044:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788813433.840217:0:25044:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff948a44763380) 00000020:00000080:2.0:1788813433.840236:0:25044:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788813433.932098:0:25044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788813433.934952:0:25044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788813433.935169:0:25044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788813433.935585:0:25044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788813433.939453:0:25044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788813433.940067:0:25044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788813433.940522:0:25044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1788813433.947224:0:25044:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788813433.947509:0:25044:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788813433.947524:0:25044:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788813433.947537:0:25044:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf32533d6ff7047df 00000020:01000004:3.0:1788813433.947545:0:25044:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788813433.947566:0:25044:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788813433.947569:0:25044:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788813433.947574:0:25044:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788813433.947601:0:25044:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788813433.947605:0:25044:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788813433.972542:0:25044:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788813433.972580:0:25044:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.113@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788813433.972584:0:25044:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788813433.972586:0:25044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788813433.972587:0:25044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813433.972588:0:25044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813433.972589:0:25044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813433.972591:0:25044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813433.972592:0:25044:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788813433.972594:0:25044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813433.972595:0:25044:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788813433.972599:0:25044:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788813433.972601:0:25044:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788813433.972602:0:25044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788813433.972607:0:25044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813433.972608:0:25044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813433.972609:0:25044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813433.972610:0:25044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813433.972611:0:25044:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788813433.972612:0:25044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813433.972613:0:25044:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788813433.972639:0:25044:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788813433.972658:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313423744:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788813433.972801:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813433.972885:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46415cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813433.973093:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313423744 00000100:00100000:2.0:1788813433.973101:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313423744 00000100:00100000:2.0:1788813433.973177:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788813433.973187:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+21:25044:x1875706313423744:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788813433.973215:0:22716:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788813433.973217:0:22716:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788813433.973221:0:22716:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788813433.973540:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+21:25044:x1875706313423744:12345-0@lo:253:mount.lustre.0 Request processed in 354us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813433.973548:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788813433.973684:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313423744:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788813433.973695:0:25044:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788813433.973697:0:25044:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788813433.973699:0:25044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788813433.973700:0:25044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813433.973701:0:25044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813433.973702:0:25044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813433.973703:0:25044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813433.973705:0:25044:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813433.973706:0:25044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813433.973707:0:25044:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788813433.973725:0:25044:0:(tgt_mount.c:101:server_register_mount()) register mount ffff948a7d688800 from lustre-OST0001 10000000:01000000:3.0:1788813433.973752:0:25044:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788813433.973755:0:25044:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788813433.973763:0:25044:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff948a6edbb380 local copy 00010000:00010000:3.0:1788813433.973773:0:25044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704420 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813433.973844:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313423872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813433.973873:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813433.973902:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894238c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813433.974053:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313423872 00000100:00100000:0.0:1788813433.974058:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313423872 00000100:00100000:0.0:1788813433.974081:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788813433.974087:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+21:25044:x1875706313423872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813433.974151:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+21:25044:x1875706313423872:12345-0@lo:501:mount.lustre.0 Request processed in 62us (276us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813433.974158:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788813433.974272:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313423872:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788813433.974283:0:25044:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788813433.974299:0:25044:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788813433.974304:0:25044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704420 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813433.974313:0:25044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff704419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704420 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813433.974335:0:25044:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff948a7d688800 10000000:01000000:3.0:1788813433.974340:0:25044:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788813433.974344:0:25044:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788813433.974346:0:25044:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788813433.974350:0:25044:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788813433.974353:0:25044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788813433.974383:0:25044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7047e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813433.974391:0:25044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7047e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813433.974488:0:25044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7047e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813433.974502:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813433.974526:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813433.974550:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894238c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813433.974595:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313424000 00000100:00100000:0.0:1788813433.974600:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313424000 00000100:00100000:0.0:1788813433.974628:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788813433.974634:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+21:25044:x1875706313424000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813433.974643:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813433.974655:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cdb600/0xf32533d6ff7047ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7047e6 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813433.974779:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdb600/0xf32533d6ff7047ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7047e6 expref: 22 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813433.974791:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cdb600/0xf32533d6ff7047ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7047e6 expref: 22 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813433.974811:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdb600, rc 0) 00000100:00100000:0.0:1788813433.974851:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+22:25044:x1875706313424000:12345-0@lo:101:mount.lustre.0 Request processed in 217us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813433.974857:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788813433.975022:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813433.975034:0:25044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7047e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7047ed expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813433.975049:0:25044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7047e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7047ed expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813433.976144:0:25044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1788813433.976787:0:25044:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813433.977139:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788813433.977163:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788813433.977175:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788813433.977186:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788813433.977197:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788813433.977208:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788813433.977219:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788813433.977230:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788813433.977242:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1788813433.977256:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1788813433.977261:0:25044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1788813433.977330:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813433.977392:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813433.977447:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894238c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813433.977549:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313424128 00000100:00100000:0.0:1788813433.977556:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313424128 00000100:00100000:0.0:1788813433.977602:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788813433.977610:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+22:25044:x1875706313424128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813433.977853:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+22:25044:x1875706313424128:12345-0@lo:501:mount.lustre.0 Request processed in 243us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813433.977861:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788813433.978118:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813433.978148:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813433.978186:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813433.978238:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894238c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813433.978267:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313424256 00000100:00100000:2.0:1788813433.978272:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313424256 00000100:00100000:2.0:1788813433.978326:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788813433.978334:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+22:25044:x1875706313424256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813433.979101:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+22:25044:x1875706313424256:12345-0@lo:503:mount.lustre.0 Request processed in 766us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813433.979110:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788813433.979225:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424256:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788813433.979766:0:25044:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788813433.979831:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813433.979881:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813433.979963:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894238c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813433.980051:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313424384 00000100:00100000:2.0:1788813433.980057:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313424384 00000100:00100000:2.0:1788813433.980092:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788813433.980098:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+22:25044:x1875706313424384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813433.980664:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+22:25044:x1875706313424384:12345-0@lo:502:mount.lustre.0 Request processed in 563us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813433.980671:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788813433.980769:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788813433.980925:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788813433.980965:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788813433.980978:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788813433.980990:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788813433.981001:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788813433.981012:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788813433.981023:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788813433.981034:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788813433.981045:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1788813433.981067:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813433.981100:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813433.981126:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894238c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813433.981254:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313424512 00000100:00100000:0.0:1788813433.981259:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313424512 00000100:00100000:0.0:1788813433.981291:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788813433.981298:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+22:25044:x1875706313424512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813433.981383:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+22:25044:x1875706313424512:12345-0@lo:502:mount.lustre.0 Request processed in 84us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813433.981389:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788813433.981569:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788813433.981604:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1788813433.981612:0:25044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788813433.982395:0:25048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788813433.982413:0:25048:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788813433.982419:0:25048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813433.982422:0:25048:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788813433.982543:0:25048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788813433.982559:0:25048:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff948a6adb0000) 00000020:00000080:3.0:1788813433.982581:0:25048:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788813433.982587:0:25048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788813433.982660:0:25048:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a7d688800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788813433.982668:0:25048:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788813433.982735:0:25048:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf32533d6ff7047fb 00010000:00010000:3.0:1788813433.987012:0:25048:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788813433.987630:0:25048:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1788813433.989164:0:25048:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788813433.990556:0:25048:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788813433.990566:0:25048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813433.990572:0:25048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813433.990573:0:25048:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788813433.990576:0:25048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813433.990580:0:25048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813433.990581:0:25048:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788813433.990584:0:25048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788813433.990586:0:25048:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788813433.990588:0:25048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813433.990590:0:25048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813433.990591:0:25048:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788813433.990593:0:25048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813433.990595:0:25048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813433.990597:0:25048:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788813433.990600:0:25048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788813433.990622:0:25048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813433.990624:0:25048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813433.990625:0:25048:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788813433.990628:0:25048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1788813433.995577:0:25044:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788813433.995622:0:25044:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788813433.995645:0:25044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7047e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7047ed expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813433.995659:0:25044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7047e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7047ed expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813433.995779:0:25044:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a7d688800 from 1 10000000:01000000:0.0:1788813433.995781:0:25044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813433.995817:0:25044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdba00/0xf32533d6ff704802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813433.995825:0:25044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cdba00/0xf32533d6ff704802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813433.995837:0:25044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cdba00/0xf32533d6ff704802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813433.995861:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813433.995926:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813433.995985:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe6f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813433.996043:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313424640 00000100:00100000:1.0:1788813433.996051:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313424640 00000100:00100000:1.0:1788813433.996098:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788813433.996107:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+22:25044:x1875706313424640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813433.996120:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813433.996132:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a43daca00/0xf32533d6ff704809 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff704802 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813433.996154:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a43daca00/0xf32533d6ff704809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff704802 expref: 23 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813433.996164:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a43daca00/0xf32533d6ff704809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704802 expref: 23 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813433.996173:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43daca00, rc 0) 00000100:00100000:1.0:1788813433.996210:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+23:25044:x1875706313424640:12345-0@lo:101:mount.lustre.0 Request processed in 103us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813433.996222:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788813433.996593:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813433.996607:0:25044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cdba00/0xf32533d6ff704802 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704809 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813433.996616:0:25044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cdba00/0xf32533d6ff704802 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff704809 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813433.998778:0:25044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788813433.999616:0:25044:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813433.999886:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788813433.999912:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788813433.999925:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788813434.000454:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788813434.000473:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788813434.000497:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788813434.000510:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788813434.000521:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788813434.000533:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788813434.000546:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788813434.000559:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788813434.000580:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788813434.000586:0:25044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788813434.000811:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813434.000880:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813434.000921:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a44c80540 going to sleep for 11 seconds 00000100:00100000:3.0:1788813434.001023:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313424768 00000100:00100000:3.0:1788813434.001030:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313424768 00000100:00100000:3.0:1788813434.001087:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788813434.001097:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+23:25044:x1875706313424768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813434.001202:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+23:25044:x1875706313424768:12345-0@lo:501:mount.lustre.0 Request processed in 107us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813434.001209:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788813434.001290:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813434.001320:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813434.001354:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813434.001383:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a44c80540 going to sleep for 11 seconds 00000100:00100000:0.0:1788813434.001396:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313424896 00000100:00100000:0.0:1788813434.001411:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313424896 00000100:00100000:0.0:1788813434.001493:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788813434.001500:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+23:25044:x1875706313424896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813434.001568:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+23:25044:x1875706313424896:12345-0@lo:503:mount.lustre.0 Request processed in 69us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813434.001575:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788813434.001608:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313424896:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788813434.002005:0:25044:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813434.002060:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813434.002093:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813434.002112:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a44c80540 going to sleep for 11 seconds 00000100:00100000:0.0:1788813434.002125:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313425024 00000100:00100000:0.0:1788813434.002129:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313425024 00000100:00100000:0.0:1788813434.002144:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788813434.002149:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+23:25044:x1875706313425024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813434.002215:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+23:25044:x1875706313425024:12345-0@lo:502:mount.lustre.0 Request processed in 65us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813434.002222:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788813434.002255:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813434.002386:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788813434.004579:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788813434.004648:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788813434.004662:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788813434.004948:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788813434.004969:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788813434.004981:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788813434.004992:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1788813434.005004:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788813434.005015:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1788813434.005026:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1788813434.005068:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813434.005134:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813434.005178:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a44c80540 going to sleep for 11 seconds 00000100:00100000:1.0:1788813434.005266:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313425152 00000100:00100000:1.0:1788813434.005273:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313425152 00000100:00100000:1.0:1788813434.005321:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788813434.005330:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+23:25044:x1875706313425152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813434.005463:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+23:25044:x1875706313425152:12345-0@lo:502:mount.lustre.0 Request processed in 134us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813434.005470:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788813434.005522:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813434.005563:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788813434.005571:0:25044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788813434.007069:0:25052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813434.007079:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813434.007081:0:25052:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788813434.007087:0:25052:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a7d688800 00000020:00000080:0.0:1788813434.007090:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813434.007097:0:25052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813434.007106:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813434.007108:0:25052:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788813434.007111:0:25052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813434.007113:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813434.007114:0:25052:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788813434.007117:0:25052:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a7d688800 00000020:00000080:0.0:1788813434.007120:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813434.007201:0:25052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813434.007204:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813434.007206:0:25052:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788813434.007208:0:25052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813434.007211:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813434.007212:0:25052:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788813434.007216:0:25052:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a7d688800 00000020:00000080:0.0:1788813434.007218:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813434.010610:0:25052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813434.010621:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813434.010623:0:25052:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788813434.010628:0:25052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813434.010632:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813434.010633:0:25052:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788813434.010638:0:25052:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a7d688800 00000020:00000080:0.0:1788813434.010640:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813434.012548:0:25052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813434.012557:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813434.012558:0:25052:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788813434.012564:0:25052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788813434.012818:0:25044:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788813434.012848:0:25044:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813434.014477:0:25044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdba00/0xf32533d6ff704802 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704809 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.014496:0:25044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cdba00/0xf32533d6ff704802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704809 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813434.014563:0:25044:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788813434.014566:0:25044:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff948a7d688800 10000000:01000000:1.0:1788813434.014569:0:25044:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff948a7d688800 10000000:01000000:1.0:1788813434.014573:0:25044:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788813434.014579:0:25044:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a7d688800 from 1 10000000:01000000:1.0:1788813434.014582:0:25044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788813434.014618:0:25044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dadc00/0xf32533d6ff704810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.014636:0:25044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a43dadc00/0xf32533d6ff704810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.014648:0:25044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a43dadc00/0xf32533d6ff704810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813434.014670:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788813434.014745:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813434.014784:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6087e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813434.015599:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313425280 00000100:00100000:3.0:1788813434.015614:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313425280 00000100:00100000:3.0:1788813434.015685:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788813434.015694:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+23:25044:x1875706313425280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813434.015708:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813434.015721:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704817 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff704810 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813434.015746:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff704810 expref: 24 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813434.015756:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a821e4c00/0xf32533d6ff704817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704810 expref: 24 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813434.015765:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4c00, rc 0) 00000100:00100000:3.0:1788813434.015806:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+24:25044:x1875706313425280:12345-0@lo:101:mount.lustre.0 Request processed in 114us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813434.015813:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788813434.018583:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813434.018610:0:25044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a43dadc00/0xf32533d6ff704810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704817 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.018622:0:25044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a43dadc00/0xf32533d6ff704810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff704817 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813434.037060:0:25044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788813434.037343:0:25044:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813434.039224:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788813434.039264:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788813434.039277:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788813434.039288:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788813434.039300:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788813434.039311:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788813434.039322:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788813434.039334:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788813434.039345:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788813434.039357:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788813434.039506:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788813434.039520:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788813434.039541:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788813434.039553:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788813434.039569:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788813434.039579:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788813434.039591:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788813434.039602:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788813434.039627:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788813434.039639:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788813434.039651:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788813434.039662:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788813434.039738:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788813434.039757:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788813434.039769:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788813434.039780:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788813434.039792:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788813434.039802:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788813434.039813:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788813434.039825:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788813434.039837:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788813434.039848:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788813434.039859:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788813434.039870:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788813434.039896:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788813434.039911:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788813434.039923:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788813434.040259:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788813434.040278:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788813434.040289:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788813434.040301:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788813434.040312:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788813434.040323:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788813434.040335:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788813434.040346:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788813434.040495:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788813434.040513:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788813434.040525:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788813434.040653:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1788813434.048495:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1788813434.048553:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1788813434.048559:0:25044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1788813434.048657:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813434.048721:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813434.048755:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894238c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813434.048920:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313425408 00000100:00100000:0.0:1788813434.048928:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313425408 00000100:00100000:0.0:1788813434.049006:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788813434.049015:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+24:25044:x1875706313425408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813434.049148:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+24:25044:x1875706313425408:12345-0@lo:501:mount.lustre.0 Request processed in 133us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813434.049164:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788813434.049259:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813434.049288:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813434.049323:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813434.049538:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894238c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813434.052529:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313425536 00000100:00100000:0.0:1788813434.052542:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313425536 00000100:00100000:0.0:1788813434.054566:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788813434.054585:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+24:25044:x1875706313425536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813434.054754:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+24:25044:x1875706313425536:12345-0@lo:503:mount.lustre.0 Request processed in 176us (5430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813434.054763:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788813434.060986:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425536:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788813434.061702:0:25044:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813434.061787:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813434.061865:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813434.061910:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894238c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813434.062068:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313425664 00000100:00100000:2.0:1788813434.062076:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313425664 00000100:00100000:2.0:1788813434.062133:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788813434.062142:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+24:25044:x1875706313425664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813434.062240:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+24:25044:x1875706313425664:12345-0@lo:502:mount.lustre.0 Request processed in 100us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813434.062248:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788813434.062583:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813434.063554:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788813434.063592:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788813434.063625:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788813434.063641:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788813434.063657:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788813434.063923:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788813434.064509:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788813434.064531:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788813434.064544:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788813434.064555:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788813434.064567:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788813434.064578:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788813434.064590:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788813434.064602:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788813434.064613:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788813434.064625:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788813434.064637:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788813434.064649:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788813434.064660:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788813434.064738:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788813434.064755:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788813434.064762:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788813434.064769:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788813434.064778:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788813434.064786:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788813434.064798:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788813434.064825:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788813434.064839:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788813434.064852:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788813434.064865:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788813434.064879:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788813434.064892:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788813434.064905:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788813434.065113:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788813434.065132:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788813434.065144:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788813434.065154:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788813434.065166:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788813434.065176:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788813434.065188:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788813434.065198:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788813434.065209:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788813434.065219:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788813434.065231:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788813434.065242:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788813434.065253:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788813434.065264:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788813434.065276:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788813434.065531:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813434.065602:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813434.065684:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe6f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813434.065808:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313425792 00000100:00100000:1.0:1788813434.065816:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313425792 00000100:00100000:1.0:1788813434.065888:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788813434.065898:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+24:25044:x1875706313425792:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813434.066060:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+24:25044:x1875706313425792:12345-0@lo:502:mount.lustre.0 Request processed in 163us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813434.066068:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788813434.066441:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788813434.066634:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788813434.066657:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788813434.066694:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425920:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813434.066733:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813434.067334:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a51688e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813434.067540:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313425920 00000100:00100000:0.0:1788813434.067547:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313425920 00000100:00100000:0.0:1788813434.067580:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788813434.067587:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+24:25044:x1875706313425920:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813434.067700:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+24:25044:x1875706313425920:12345-0@lo:502:mount.lustre.0 Request processed in 112us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813434.067715:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788813434.067862:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313425920:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788813434.067915:0:25044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788813434.067925:0:25044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788813434.068762:0:25058:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788813434.068776:0:25058:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff948a7b703380) 00000020:00000080:0.0:1788813434.068799:0:25058:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788813434.068885:0:25058:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a7d688800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788813434.068890:0:25058:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a7d688800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788813434.068892:0:25058:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7d688800 3 00010000:00080000:0.0:1788813434.068921:0:25058:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948942077000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.113@tcp at head 00010000:00010000:0.0:1788813434.071618:0:25058:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788813434.072009:0:25058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788813434.072050:0:25058:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788813434.072061:0:25058:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf32533d6ff704825 00000100:00080000:0.0:1788813434.072071:0:25058:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788813434.072081:0:25058:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff948942077000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813434.072117:0:25058:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a76404000 x1875706313426048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813434.072134:0:25058:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788813434.072195:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813434.072199:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788813434.072201:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a7b57d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813434.072205:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 586 00000100:00080000:0.0:1788813434.072208:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788813434.072212:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948a7b57d800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813434.072224:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a6eda5880 x1875706313426432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813434.072248:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813434.072256:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788813434.072257:0:36:0:(import.c:65:import_set_state_nolock()) ffff948941924000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813434.072260:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 586 00000100:00080000:0.0:1788813434.072262:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788813434.072266:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff948941924000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813434.072276:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94894435e300 x1875706313426944/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788813434.072411:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313426688:0@lo:400:kworker.0 00000100:00100000:3.0:1788813434.072481:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813434.072512:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788813434.072518:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313426176:0@lo:400:kworker.0 00000100:00100000:3.0:1788813434.072536:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813434.072552:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313426816:0@lo:400:kworker.0 00000100:00100000:3.0:1788813434.072570:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813434.072592:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313426688 00000100:00100000:3.0:1788813434.072599:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313426688 00000100:00100000:3.0:1788813434.072630:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313426176 00000100:00100000:3.0:1788813434.072632:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313426176 00000100:00100000:3.0:1788813434.072645:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788813434.072652:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313426688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813434.072712:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313426688:12345-0@lo:400:kworker.0 Request processed in 59us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813434.072719:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788813434.072732:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813434.072738:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313426176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813434.072759:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313426176:12345-0@lo:400:kworker.0 Request processed in 22us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813434.072764:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813434.072796:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313426176:0@lo:400:kworker.0 00000100:00100000:3.0:1788813434.072804:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313426688:0@lo:400:kworker.0 00000100:00100000:3.0:1788813434.073135:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313427328:0@lo:400:kworker.0 00000100:00100000:3.0:1788813434.073162:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813434.073250:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313426048:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788813434.073291:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813434.073322:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313426432:0@lo:8:kworker.0 00000100:00100000:1.0:1788813434.073342:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813434.073354:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313426944:0@lo:8:kworker.0 00000100:00100000:1.0:1788813434.073381:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813434.073420:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313426304:0@lo:400:kworker.0 00000100:00100000:1.0:1788813434.073598:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813434.073615:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313427072:0@lo:400:kworker.0 00000100:00100000:1.0:1788813434.073632:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813434.073649:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788813434.073655:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313426560:0@lo:400:kworker.0 00000100:00100000:1.0:1788813434.073683:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813434.073693:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313427200:0@lo:400:kworker.0 00000100:00100000:1.0:1788813434.073709:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813434.073733:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313426816 00000100:00100000:1.0:1788813434.073737:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313426816 00000100:00100000:1.0:1788813434.073764:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313426432 00000100:00100000:1.0:1788813434.073766:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313426432 00000100:00100000:1.0:1788813434.073773:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313426944 00000100:00100000:1.0:1788813434.073775:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313426944 00000100:00100000:1.0:1788813434.073780:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313426304 00000100:00100000:1.0:1788813434.073782:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313426304 00000100:00100000:1.0:1788813434.073793:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813434.073799:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313426816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813434.073840:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313426816:12345-0@lo:400:kworker.0 Request processed in 41us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813434.073846:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813434.073857:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813434.073863:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313426304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813434.073887:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313426304:12345-0@lo:400:kworker.0 Request processed in 24us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813434.073892:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813434.073903:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813434.073914:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3624:x1875706313426432:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788813434.073980:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3624:x1875706313426432:12345-0@lo:8:kworker.0 Request processed in 64us (636us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788813434.073985:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813434.073996:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813434.074000:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3624:x1875706313426944:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788813434.074022:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3624:x1875706313426944:12345-0@lo:8:kworker.0 Request processed in 22us (640us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788813434.074028:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813434.074046:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313427328 00000100:00100000:1.0:1788813434.074049:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313427328 00000100:00100000:1.0:1788813434.074065:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313426048 00000100:00100000:1.0:1788813434.074067:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313426048 00000100:00100000:1.0:1788813434.074073:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313427072 00000100:00100000:1.0:1788813434.074075:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313427072 00000100:00100000:1.0:1788813434.074082:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313426560 00000100:00100000:1.0:1788813434.074084:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313426560 00000100:00100000:1.0:1788813434.074091:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313427200 00000100:00100000:1.0:1788813434.074094:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313427200 00000100:00100000:1.0:1788813434.074103:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788813434.074108:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313427328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813434.074133:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313427328:12345-0@lo:400:kworker.0 Request processed in 25us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813434.074138:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788813434.074147:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813434.074152:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313427072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813434.074173:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313427072:12345-0@lo:400:kworker.0 Request processed in 21us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813434.074187:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813434.074197:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788813434.074202:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313426560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813434.074224:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313426560:12345-0@lo:400:kworker.0 Request processed in 23us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813434.074230:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788813434.074239:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788813434.074243:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313427200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813434.074262:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313427200:12345-0@lo:400:kworker.0 Request processed in 19us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813434.074267:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788813434.074276:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813434.074292:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3624:x1875706313426048:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788813434.074306:0:22724:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:1.0:1788813434.074347:0:22724:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf32533d6ff70482c 00000004:00100000:1.0:1788813434.074370:0:22724:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788813434.074737:0:22724:0:(import.c:65:import_set_state_nolock()) ffff948942c79000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813434.074776:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875706313426048:12345-0@lo:38:llog_process_th.0 Request processed in 483us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813434.074782:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788813434.074817:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94894435f800 x1875706313427328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813434.074828:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313427328:0@lo:400:kworker.0 00000100:00100000:1.0:1788813434.074839:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313426816:0@lo:400:kworker.0 00010000:00080000:1.0:1788813434.075011:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76404000 x1875706313426048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813434.075019:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813434.075025:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788813434.075032:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788813434.075037:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788813434.075039:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948942077000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788813434.075044:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313426048:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788813434.075052:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813434.075055:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b57d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788813434.075059:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788813434.075062:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313426432:0@lo:8:kworker.0 00000100:00100000:1.0:1788813434.075069:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813434.075072:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948941924000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788813434.075075:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788813434.075078:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313426944:0@lo:8:kworker.0 00010000:00080000:1.0:1788813434.075104:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94894435ed80 x1875706313426560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813434.075111:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313426560:0@lo:400:kworker.0 00010000:00080000:1.0:1788813434.075120:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94894435df80 x1875706313427200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813434.075127:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313427200:0@lo:400:kworker.0 00000100:00100000:1.0:1788813434.075136:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313426304:0@lo:400:kworker.0 00010000:00080000:1.0:1788813434.075152:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94894435f480 x1875706313427072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813434.075160:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313427072:0@lo:400:kworker.0 00000020:01000004:0.0:1788813434.075648:0:25058:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788813434.075664:0:25058:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff948942dccd40) 00000020:00000080:0.0:1788813434.075825:0:25058:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788813434.075899:0:25058:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a7d688800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788813434.075904:0:25058:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a7d688800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788813434.075906:0:25058:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7d688800 3 00010000:00080000:0.0:1788813434.075971:0:25058:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948942075800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.113@tcp at head 00010000:00010000:0.0:1788813434.080654:0:25058:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788813434.080961:0:25058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788813434.081005:0:25058:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788813434.081016:0:25058:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf32533d6ff70483a 00000100:00080000:0.0:1788813434.081026:0:25058:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788813434.081038:0:25058:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff948942075800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813434.081071:0:25058:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94894435fb80 x1875706313427456/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813434.081098:0:25058:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788813434.081316:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1875706313427456:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788813434.081392:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813434.081597:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313427456 00000100:00100000:2.0:1788813434.081605:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313427456 00000100:00100000:2.0:1788813434.081635:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813434.081642:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1875706313427456:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788813434.081670:0:22723:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:2.0:1788813434.081767:0:22723:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf32533d6ff704841 00000004:00100000:2.0:1788813434.081785:0:22723:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788813434.081819:0:22723:0:(import.c:65:import_set_state_nolock()) ffff948a7d68d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813434.081868:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875706313427456:12345-0@lo:38:llog_process_th.0 Request processed in 224us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813434.081883:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788813434.081921:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94894435fb80 x1875706313427456/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813434.081948:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788813434.081957:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788813434.081964:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788813434.081968:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788813434.081970:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948942075800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788813434.081976:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1875706313427456:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788813434.090034:0:22759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788813434.091457:0:25058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1788813434.091569:0:25044:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788813434.091609:0:25044:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788813434.091635:0:25044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dadc00/0xf32533d6ff704810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704817 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813434.091648:0:25044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a43dadc00/0xf32533d6ff704810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704817 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788813434.091704:0:25044:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788813434.091706:0:25044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813434.091707:0:25044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813434.091709:0:25044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813434.091710:0:25044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813434.091712:0:25044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813434.091713:0:25044:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813434.091715:0:25044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813434.091716:0:25044:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813434.091719:0:25044:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788813434.091721:0:25044:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788813434.091723:0:25044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813434.091727:0:25044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813434.091728:0:25044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813434.091729:0:25044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813434.091730:0:25044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813434.091731:0:25044:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813434.091732:0:25044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813434.091733:0:25044:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813434.091758:0:25044:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788813434.091775:0:25044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313427584:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788813434.091834:0:25044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813434.091874:0:25044:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a51688840 going to sleep for 11 seconds 00000100:00100000:1.0:1788813434.091910:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313427584 00000100:00100000:1.0:1788813434.091919:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313427584 00000100:00100000:1.0:1788813434.091992:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788813434.092004:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+24:25044:x1875706313427584:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788813434.092029:0:22716:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788813434.092056:0:22716:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788813434.099740:0:22716:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788813434.099761:0:22716:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788813434.100052:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+24:25044:x1875706313427584:12345-0@lo:253:mount.lustre.0 Request processed in 8047us (8212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813434.100073:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788813434.100183:0:25044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:151fd599-5695-4163-8caa-7faa559323aa:25044:1875706313427584:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788813434.100195:0:25044:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788813434.100198:0:25044:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788813434.100200:0:25044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813434.100202:0:25044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813434.100203:0:25044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813434.100205:0:25044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813434.100206:0:25044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813434.100208:0:25044:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813434.100209:0:25044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813434.100210:0:25044:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788813434.100223:0:25044:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788813434.101027:0:22739:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788813434.101033:0:22739:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788813434.101052:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a43dad400/0xf32533d6ff704848 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.101067:0:22739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a44cda600/0xf32533d6ff7046dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7046d5 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.101075:0:22739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7046ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7046e3 expref: 23 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.101084:0:22739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948a43dad400/0xf32533d6ff704848 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.101117:0:22739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7046ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7046e3 expref: 23 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.101131:0:22739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7046ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7046e3 expref: 23 pid: 22716 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813434.101155:0:22739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22739:1875706313427712:0@lo:104: 00000100:00100000:1.0:1788813434.101194:0:22739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813434.101244:0:22739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a44cda600/0xf32533d6ff7046dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7046d5 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.101253:0:22739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a44cda600/0xf32533d6ff7046dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7046d5 expref: 23 pid: 22717 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813434.101261:0:22739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22739:1875706313427840:0@lo:104: 00000100:00100000:1.0:1788813434.101339:0:22739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813434.101612:0:22739:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42b99480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813434.101629:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313427712 00000100:00100000:1.0:1788813434.101635:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313427712 00000100:00100000:1.0:1788813434.101665:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313427840 00000100:00100000:1.0:1788813434.101668:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313427840 00000100:00100000:2.0:1788813434.101762:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813434.101772:0:22707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:151fd599-5695-4163-8caa-7faa559323aa+4:22739:x1875706313427712:12345-0@lo:104: 00010000:00010000:2.0:1788813434.101784:0:22707:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948941a80000/0xf32533d6ff7046e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7046ea expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813434.101841:0:22707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788813434.101846:0:22707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:151fd599-5695-4163-8caa-7faa559323aa+4:22739:x1875706313427712:12345-0@lo:104: Request processed in 77us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813434.101852:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813434.101911:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813434.101917:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+3:22739:x1875706313427840:12345-0@lo:104: 00010000:00010000:1.0:1788813434.101925:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff7046d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7046dc expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.101981:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813434.101986:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+3:22739:x1875706313427840:12345-0@lo:104: Request processed in 70us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813434.101992:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788813434.102006:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813434.102012:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948941a80000/0xf32533d6ff7046e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7046ea expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.102030:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a80000 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813434.102033:0:22711:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948941a80000/0xf32533d6ff7046e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7046ea expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.102042:0:22711:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948941a80000/0xf32533d6ff7046e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7046ea expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813434.102049:0:22711:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948941a80000/0xf32533d6ff7046e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7046ea expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813434.102054:0:22711:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813434.102079:0:22711:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948941a80000/0xf32533d6ff7046e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7046ea expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.102085:0:22711:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813434.102102:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948941a80000/0xf32533d6ff7046e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7046ea expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.102109:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948941a80000/0xf32533d6ff7046e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7046ea expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.102121:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813434.102124:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff7046d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7046dc expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.102130:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9600 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813434.102133:0:22711:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff7046d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7046dc expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.102148:0:22711:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff7046d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7046dc expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813434.102155:0:22711:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff7046d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7046dc expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813434.102160:0:22711:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813434.102171:0:22711:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff7046d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7046dc expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.102176:0:22711:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813434.102190:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff7046d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7046dc expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.102197:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff7046d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7046dc expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.102209:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813434.102211:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813434.102213:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813434.102218:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813434.102235:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313427968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813434.102261:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813434.102909:0:22739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22739:1875706313427712:0@lo:104: 00000100:00100000:0.0:1788813434.102920:0:22739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22739:1875706313427840:0@lo:104: 00010000:00010000:0.0:1788813434.102959:0:22739:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948a43dad400/0xf32533d6ff704848 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813434.104651:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313428096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813434.104847:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813434.104902:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313427968 00000100:00100000:1.0:1788813434.104909:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313427968 00010000:00010000:1.0:1788813434.104962:0:22710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7046ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7046e3 expref: 24 pid: 22716 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813434.104995:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313428096 00000100:00100000:1.0:1788813434.104997:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313428096 00010000:00010000:1.0:1788813434.105009:0:22710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a44cda600/0xf32533d6ff7046dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7046d5 expref: 25 pid: 22717 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813434.105021:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813434.105028:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:151fd599-5695-4163-8caa-7faa559323aa+25:3626:x1875706313427968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813434.105040:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813434.105044:0:22710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7046ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7046e3 expref: 25 pid: 22716 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.105055:0:22710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7046ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7046e3 expref: 25 pid: 22716 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.105070:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7046ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7046e3 expref: 25 pid: 22716 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.105082:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813434.105115:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:151fd599-5695-4163-8caa-7faa559323aa+24:3626:x1875706313427968:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (2853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813434.105122:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813434.105136:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813434.105140:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:151fd599-5695-4163-8caa-7faa559323aa+23:3627:x1875706313428096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813434.105147:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813434.105151:0:22710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a44cda600/0xf32533d6ff7046dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7046d5 expref: 23 pid: 22717 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.105159:0:22710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a44cda600/0xf32533d6ff7046dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7046d5 expref: 23 pid: 22717 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.105174:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cda600/0xf32533d6ff7046dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7046d5 expref: 23 pid: 22717 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.105185:0:22710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948a43dad400/0xf32533d6ff704848 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.105193:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a43dad400/0xf32533d6ff704848 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788813434.105206:0:22710:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004833932s 00010000:00010000:1.0:1788813434.105210:0:22710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a43dad400/0xf32533d6ff704848 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.105217:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a43dad400/0xf32533d6ff704848 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.105225:0:22710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a43dad400/0xf32533d6ff704848 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.105232:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a43dad400/0xf32533d6ff704848 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.105237:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813434.105241:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a43dad400/0xf32533d6ff704848 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.105249:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a43dad400/0xf32533d6ff704848 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.105263:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a43dad400/0xf32533d6ff704848 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.105277:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:2.0:1788813434.105743:0:25044:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1788813434.106847:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:151fd599-5695-4163-8caa-7faa559323aa+22:3627:x1875706313428096:12345-0@lo:103:ldlm_bl.0 Request processed in 1702us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813434.106858:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813434.106905:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313427968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813434.106952:0:22739:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948a43dad400/0xf32533d6ff704848 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.106963:0:22739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a43dad400/0xf32533d6ff704848 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813434.106970:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a43dad400/0xf32533d6ff704848 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813434.107307:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:151fd599-5695-4163-8caa-7faa559323aa:3627:1875706313428096:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1788813434.110419:0:25044:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788813434.110488:0:25044:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788813434.110527:0:25044:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788813434.110572:0:25044:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788813434.110592:0:25044:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788813434.110634:0:25044:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788813434.115884:0:25044:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788813434.116153:0:25044:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788813434.213346:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313428224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813434.213448:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813434.213505:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313428224 00000100:00100000:3.0:1788813434.213513:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313428224 00000100:00100000:3.0:1788813434.213553:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788813434.213561:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313428224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788813434.213592:0:22729:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788813434.213632:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313428224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813434.213638:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788813434.213662:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313428352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813434.213698:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813434.213724:0:23758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313428352 00000100:00100000:3.0:1788813434.213727:0:23758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313428352 00000100:00100000:3.0:1788813434.213747:0:23758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788813434.213752:0:23758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313428352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788813434.213768:0:23758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788813434.213797:0:23758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313428352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813434.213803:0:23758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788813434.213846:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313428352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813434.213879:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313428224:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788813434.796451:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788813435.578834:0:25112:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813435.579129:0:25112:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788813435.812953:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788813435.879606:0:22720:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788813435.879614:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a6eab6800 from 14 10000000:01000000:0.0:1788813435.879621:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788813435.879670:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdb200/0xf32533d6ff70484f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813435.879682:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cdb200/0xf32533d6ff70484f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813435.879694:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cdb200/0xf32533d6ff70484f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813435.879731:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313428480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813435.879798:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813435.879857:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6087e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813435.880032:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313428480 00000100:00100000:3.0:1788813435.880043:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313428480 00000100:00100000:3.0:1788813435.880107:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788813435.880118:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+22:22720:x1875706313428480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813435.880133:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813435.880148:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a821e4e00/0xf32533d6ff704856 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70484f expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813435.880170:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e4e00/0xf32533d6ff704856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70484f expref: 23 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813435.880181:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a821e4e00/0xf32533d6ff704856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70484f expref: 23 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813435.880189:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4e00, rc 0) 00000100:00100000:3.0:1788813435.880232:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+23:22720:x1875706313428480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813435.880239:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788813435.880537:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313428480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813435.880559:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cdb200/0xf32533d6ff70484f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704856 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813435.880568:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cdb200/0xf32533d6ff70484f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff704856 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813435.880626:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313428608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788813435.880662:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813435.880682:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6087e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813435.880789:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313428608 00000100:00100000:1.0:1788813435.880796:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313428608 00000100:00100000:1.0:1788813435.880833:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788813435.880841:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+23:22720:x1875706313428608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788813435.880855:0:22716:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788813435.880871:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788813435.880874:0:22716:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788813435.880968:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+23:22720:x1875706313428608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813435.880976:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788813435.881064:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313428608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788813435.881200:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788813435.881208:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdb200/0xf32533d6ff70484f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704856 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813435.881216:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cdb200/0xf32533d6ff70484f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704856 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813435.881224:0:22720:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788813435.881227:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9489430d0800 from 14 10000000:01000000:0.0:1788813435.881230:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788813435.881249:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff70485d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813435.881256:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff70485d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813435.881264:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff70485d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813435.881283:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313428736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813435.881310:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813435.881328:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6087e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813435.881452:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313428736 00000100:00100000:3.0:1788813435.881457:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313428736 00000100:00100000:3.0:1788813435.881490:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788813435.881498:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+23:22720:x1875706313428736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813435.881505:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813435.881516:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a821e4200/0xf32533d6ff704864 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70485d expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813435.881543:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e4200/0xf32533d6ff704864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70485d expref: 24 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813435.881552:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a821e4200/0xf32533d6ff704864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70485d expref: 24 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813435.881558:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4200, rc 0) 00000100:00100000:3.0:1788813435.881595:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+24:22720:x1875706313428736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813435.881601:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788813435.881631:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313428736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813435.881641:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff70485d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704864 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813435.881649:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff70485d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff704864 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813435.881683:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313428864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788813435.881721:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813435.881733:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813435.881742:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313428864 00000100:00100000:3.0:1788813435.881746:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313428864 00000100:00100000:3.0:1788813435.881760:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788813435.881765:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a75579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+24:22720:x1875706313428864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788813435.881775:0:22718:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788813435.881785:0:22718:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788813435.881790:0:22718:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788813435.881841:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a75579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+24:22720:x1875706313428864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 75us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813435.881848:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788813435.881870:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313428864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788813435.881903:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788813435.881908:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff70485d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704864 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813435.881916:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff70485d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704864 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813436.841191:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813437.862038:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813438.310489:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813438.310518:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313429120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813438.310540:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313428992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813438.311464:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813438.313107:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313429120 00000100:00100000:3.0:1788813438.313130:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313429120 00000100:00100000:3.0:1788813438.313228:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788813438.313246:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313429120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788813438.313295:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788813438.313418:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313429120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 179us (2273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813438.313426:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813438.315998:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788813438.316482:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813438.321232:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313428992 00000100:00100000:3.0:1788813438.321255:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313428992 00000100:00100000:3.0:1788813438.321406:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813438.321419:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313428992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813438.321455:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788813438.321573:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313428992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (5587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813438.321599:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813438.321681:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313428992:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788813438.321802:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813438.322428:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313429120:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788813438.885143:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788813439.335293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813439.335301:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788813439.335305:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a7b57d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813439.335335:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948a7b57d800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813439.335375:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94894435ca80 x1875706313429888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813439.335416:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813439.335420:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:3.0:1788813439.335671:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313429888:0@lo:8:kworker.0 00000100:00080000:0.0:1788813439.335807:0:36:0:(import.c:65:import_set_state_nolock()) ffff948941924000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813439.335816:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff948941924000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813439.335831:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94894435d180 x1875706313430400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813439.336224:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:151fd599-5695-4163-8caa-7faa559323aa:3628:1875706313429248:0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.336261:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.336299:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313429760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813439.336384:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.336405:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313430528:0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.336467:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.336486:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313431040:0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.336519:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.336543:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788813439.336550:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313429632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813439.336588:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.336606:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313430272:0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.336636:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313429376:0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.336653:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.336670:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313430016:0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.336691:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.336707:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313430656:0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.336726:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.336751:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788813439.336757:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313429504:0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.336792:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313429248 00000100:00100000:0.0:1788813439.336799:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313429248 00000100:00100000:0.0:1788813439.336858:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788813439.336868:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a75579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+24:3628:x1875706313429248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.336921:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a75579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+24:3628:x1875706313429248:12345-0@lo:400:kworker.0 Request processed in 54us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813439.336928:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788813439.337177:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.337597:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313429760 00000100:00100000:0.0:1788813439.337603:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313429760 00000100:00100000:0.0:1788813439.337625:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313429632 00000100:00100000:0.0:1788813439.337628:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313429632 00000100:00100000:0.0:1788813439.337641:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313429376 00000100:00100000:0.0:1788813439.337643:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313429376 00000100:00100000:1.0:1788813439.337649:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313429888 00000100:00100000:1.0:1788813439.337653:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313429888 00000100:00100000:0.0:1788813439.337663:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788813439.337669:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313429760:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813439.337683:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813439.337690:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3624:x1875706313429888:12345-0@lo:8:kworker.0 00000004:00000024:0.0:1788813439.337697:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00010000:00080000:1.0:1788813439.337714:0:24231:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:1.0:1788813439.337746:0:24231:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff70486b 00002000:00100000:1.0:1788813439.337758:0:24231:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff948942c7e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788813439.337762:0:24231:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788813439.337765:0:24231:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788813439.337964:0:24231:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788813439.337989:0:24231:0:(import.c:65:import_set_state_nolock()) ffff948942c7d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813439.338272:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3624:x1875706313429888:12345-0@lo:8:kworker.0 Request processed in 580us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813439.338272:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313429760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 602us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813439.338281:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788813439.338281:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788813439.338298:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788813439.338304:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313429632:12345-0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1788813439.338565:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894435ca80 x1875706313429888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00000024:0.0:1788813439.338597:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788813439.338663:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313429632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 358us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813439.338670:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788813439.338683:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788813439.338689:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313429376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.338715:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313429376:12345-0@lo:400:kworker.0 Request processed in 26us (2060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813439.338720:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788813439.338810:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788813439.338819:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788813439.338825:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788813439.338827:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b57d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788813439.338866:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313430528 00000100:00100000:0.0:1788813439.338872:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313430528 00000100:00100000:0.0:1788813439.338894:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313431040 00000100:00100000:0.0:1788813439.338897:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313431040 00000004:00080000:3.0:1788813439.339301:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788813439.339309:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313429888:0@lo:8:kworker.0 00000004:00080000:1.0:1788813439.339329:0:22749:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788813439.339334:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313430400:0@lo:8:kworker.0 00000100:00100000:3.0:1788813439.339381:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788813439.339419:0:22749:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 592358486118ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788813439.339426:0:22749:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788813439.339621:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313430400 00000100:00100000:2.0:1788813439.339626:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313430400 00000100:00100000:2.0:1788813439.339657:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788813439.339663:0:24230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3624:x1875706313430400:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788813439.339691:0:24230:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:2.0:1788813439.339716:0:24230:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff704872 00002000:00100000:2.0:1788813439.339727:0:24230:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9489433ba000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788813439.339731:0:24230:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788813439.339734:0:24230:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788813439.339771:0:24230:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788813439.339788:0:24230:0:(import.c:65:import_set_state_nolock()) ffff9489433bf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813439.340229:0:24230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3624:x1875706313430400:12345-0@lo:8:kworker.0 Request processed in 563us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813439.340236:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788813439.340267:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894435d180 x1875706313430400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788813439.340279:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788813439.340285:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788813439.340289:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788813439.340291:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948941924000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788813439.340310:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788813439.340314:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313430400:0@lo:8:kworker.0 00000100:00100000:2.0:1788813439.340413:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:1.0:1788813439.340436:0:23467:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788813439.340457:0:23467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23467:1875706313431296:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788813439.340485:0:23467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813439.340503:0:23467:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6087e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813439.340530:0:24816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313431296 00000100:00100000:1.0:1788813439.340533:0:24816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313431296 00000100:00100000:2.0:1788813439.340570:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313431168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813439.340595:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813439.340619:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313431168 00000100:00100000:2.0:1788813439.340623:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313431168 00000100:00100000:2.0:1788813439.340648:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813439.340655:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3626:x1875706313431168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813439.340672:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788813439.340705:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3626:x1875706313431168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813439.340710:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788813439.340735:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943489880 x1875706313431168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813439.340749:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313431168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813439.341381:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313430016 00000100:00100000:3.0:1788813439.341387:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313430016 00000100:00100000:3.0:1788813439.341409:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313430656 00000100:00100000:3.0:1788813439.341412:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313430656 00000100:00100000:0.0:1788813439.341539:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788813439.341548:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313430528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.341594:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313430528:12345-0@lo:400:kworker.0 Request processed in 48us (5127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813439.341601:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788813439.341622:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788813439.341628:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313430016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.341657:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313430016:12345-0@lo:400:kworker.0 Request processed in 30us (4965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813439.341663:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788813439.341676:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788813439.341682:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313431040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.341708:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313431040:12345-0@lo:400:kworker.0 Request processed in 27us (5189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813439.341713:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000004:00080000:0.0:1788813439.341770:0:22750:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1788813439.341784:0:22750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22750:1875706313431552:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788813439.341809:0:22750:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.341826:0:22750:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082000 going to sleep for 11 seconds 00000004:00080000:0.0:1788813439.341968:0:23466:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788813439.342093:0:23466:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 592361159972ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788813439.342100:0:23466:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788813439.343403:0:24816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313431552 00000100:00100000:1.0:1788813439.343413:0:24816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313431552 00000100:00100000:1.0:1788813439.343458:0:24816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788813439.343467:0:24816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23467:x1875706313431296:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788813439.343724:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788813439.343733:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22750:x1875706313431552:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788813439.344494:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813439.344542:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313430912:0@lo:400:kworker.0 00000100:00100000:1.0:1788813439.344645:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813439.345445:0:24228:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788813439.345456:0:24228:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000004:00080000:1.0:1788813439.345496:0:22703:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788813439.345547:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:151fd599-5695-4163-8caa-7faa559323aa:3628:1875706313429248:0@lo:400:kworker.0 00000100:00100000:1.0:1788813439.345569:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313429760:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1788813439.345584:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894435d500 x1875706313430528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813439.345595:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313430528:0@lo:400:kworker.0 00010000:00080000:1.0:1788813439.345610:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894435df80 x1875706313431040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813439.345619:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313431040:0@lo:400:kworker.0 00000100:00100000:1.0:1788813439.345653:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313429632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813439.346155:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313430912 00000100:00100000:3.0:1788813439.346163:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313430912 00000100:00100000:3.0:1788813439.346184:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788813439.346192:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313430656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813439.346681:0:24230:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788813439.346691:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313430272 00000100:00100000:2.0:1788813439.346695:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313430272 00000100:00100000:2.0:1788813439.346716:0:24230:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788813439.346723:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813439.346729:0:24230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313430272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813439.346824:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313430656:12345-0@lo:400:kworker.0 Request processed in 632us (10095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813439.346855:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788813439.346876:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788813439.346882:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313430912:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788813439.347257:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813439.347264:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813439.347267:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813439.347598:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313431424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813439.347870:0:24230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313430272:12345-0@lo:400:kworker.0 Request processed in 1139us (3376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813439.347879:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813439.347990:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.348036:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.348057:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313430144:0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.348085:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.348103:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313430784:0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.348138:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.348168:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313429376:0@lo:400:kworker.0 00010000:00080000:0.0:1788813439.348184:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894435c000 x1875706313430016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813439.348194:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313430016:0@lo:400:kworker.0 00010000:00080000:0.0:1788813439.348204:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894435d880 x1875706313430656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813439.348211:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313430656:0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.348239:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313430144 00000100:00100000:0.0:1788813439.348244:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313430144 00000100:00100000:0.0:1788813439.348417:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813439.348651:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313430144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.348704:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313430144:12345-0@lo:400:kworker.0 Request processed in 57us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813439.348711:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813439.348819:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313430144:0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.348915:0:22725:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788813439.348923:0:22725:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788813439.349045:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313429504 00000100:00100000:0.0:1788813439.349050:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313429504 00000100:00100000:0.0:1788813439.349072:0:24228:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788813439.349079:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788813439.349085:0:24228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313429504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813439.349121:0:24228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313429504:12345-0@lo:400:kworker.0 Request processed in 37us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813439.349136:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788813439.349162:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313429504:0@lo:400:kworker.0 00000100:00100000:2.0:1788813439.349883:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313431424 00000100:00100000:2.0:1788813439.349888:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313431424 00000100:00100000:2.0:1788813439.349946:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813439.349956:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1875706313431424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813439.349975:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788813439.350036:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1875706313431424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813439.350041:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788813439.350078:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489436e6680 x1875706313431424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813439.350096:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313431424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813439.350142:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313430912:12345-0@lo:400:kworker.0 Request processed in 2954us (5191us total) trans 0 rc 0/0 00000004:00080000:2.0:1788813439.350150:0:23456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788813439.350153:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788813439.350171:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313430784 00000100:00100000:3.0:1788813439.350175:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313430784 00000100:00100000:2.0:1788813439.350190:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313430272:0@lo:400:kworker.0 00000100:00100000:3.0:1788813439.350206:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788813439.350207:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894435f480 x1875706313430912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813439.350212:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313430784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813439.350216:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313430912:0@lo:400:kworker.0 00000100:00100000:3.0:1788813439.350249:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313430784:12345-0@lo:400:kworker.0 Request processed in 37us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813439.350255:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788813439.350280:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788813439.350299:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894435fb80 x1875706313430784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813439.350308:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313430784:0@lo:400:kworker.0 00002000:00080000:1.0:1788813439.351527:0:24816:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788813439.351535:0:24816:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788813439.351650:0:24816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23467:x1875706313431296:12345-0@lo:7:osp-pre-1-1.0 Request processed in 8182us (11160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813439.351660:0:24816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788813439.351724:0:23467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943488a80 x1875706313431296/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788813455 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788813439.353599:0:24231:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788813439.353610:0:24231:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:2.0:1788813439.353619:0:24231:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00000100:00100000:3.0:1788813439.355450:0:23467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23467:1875706313431296:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788813439.355469:0:23467:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788813439.356212:0:23467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23467:1875706313431680:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788813439.356277:0:23467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813439.356312:0:23467:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6087e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813439.356494:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313431680 00000100:00100000:0.0:1788813439.356502:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313431680 00000100:00100000:0.0:1788813439.356557:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813439.356566:0:24228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23467:x1875706313431680:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788813439.356595:0:24228:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788813439.356638:0:24228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23467:x1875706313431680:12345-0@lo:5:osp-pre-1-1.0 Request processed in 73us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813439.359548:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788813439.359638:0:23467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948941ba4e00 x1875706313431680/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813455 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813439.359654:0:23467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23467:1875706313431680:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788813439.359668:0:23467:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788813439.359726:0:23467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23467:1875706313431808:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788813439.362169:0:23467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.362212:0:23467:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813439.362242:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313431808 00000100:00100000:0.0:1788813439.362250:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313431808 00000100:00100000:0.0:1788813439.362298:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813439.362307:0:24230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23467:x1875706313431808:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788813439.362359:0:24230:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:2.0:1788813439.384741:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813439.384754:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7b73d8f/0xf32533d6ff704879 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.384771:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1788813439.384775:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813439.384782:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b73d8f/0xf32533d6ff704879 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.384800:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7b73d8f/0xf32533d6ff704879 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.384823:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7b73d8f/0xf32533d6ff704879 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.384832:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b73d8f/0xf32533d6ff704879 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.384856:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813439.385066:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813439.385073:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7b73d8f/0xf32533d6ff704879 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.385081:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a80a00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813439.385086:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7b73d8f/0xf32533d6ff704879 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.385095:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7b73d8f/0xf32533d6ff704879 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.385114:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7b73d8f/0xf32533d6ff704879 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.385122:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7b73d8f/0xf32533d6ff704879 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.385139:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813439.385141:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813439.385143:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813439.386926:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813439.386978:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff704880 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.386993:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=592s v=(0 0) 00010000:00010000:1.0:1788813439.387003:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813439.387010:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff704880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387025:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff704880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387035:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff704880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387043:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff704880 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387056:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788813439.387563:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813439.387570:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff704887 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387580:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=592s v=(0 0) 00010000:00010000:1.0:1788813439.387583:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813439.387588:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff704887 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387598:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff704887 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387607:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff704887 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387619:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff704887 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387633:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788813439.387643:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813439.387649:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff704880 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387656:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813439.387661:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff704880 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387670:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff704880 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387685:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff704880 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387692:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff704880 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387707:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813439.387710:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff704887 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387726:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dade00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813439.387730:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff704887 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387738:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff704887 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387748:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff704887 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387755:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff704887 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.387769:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813439.387770:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813439.387772:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.387987:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813439.389110:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813439.389118:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e64e1e8d/0xf32533d6ff70488e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.389130:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1788813439.389134:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813439.389139:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e64e1e8d/0xf32533d6ff70488e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.389151:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e64e1e8d/0xf32533d6ff70488e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.389160:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e64e1e8d/0xf32533d6ff70488e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.389167:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e64e1e8d/0xf32533d6ff70488e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.389200:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813439.390119:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813439.390129:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e64e1e8d/0xf32533d6ff70488e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.390140:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a81e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813439.390144:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e64e1e8d/0xf32533d6ff70488e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.390154:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e64e1e8d/0xf32533d6ff70488e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.390181:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e64e1e8d/0xf32533d6ff70488e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.390189:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e64e1e8d/0xf32533d6ff70488e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.390210:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813439.390212:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813439.390214:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813439.390907:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813439.390915:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff704895 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.390927:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=592s v=(0 0) 00010000:00010000:1.0:1788813439.390966:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813439.390973:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff704895 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.390985:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff704895 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.390994:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff704895 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.391002:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff704895 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.391026:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813439.391912:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813439.391920:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff704895 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.391962:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813439.391967:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff704895 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.391976:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff704895 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.391993:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff704895 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.392001:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff704895 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.392023:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.392025:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.392027:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813439.393600:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813439.393611:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff70489c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.393627:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1788813439.393632:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813439.393638:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff70489c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.393653:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff70489c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.393663:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff70489c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.393671:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff70489c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.393694:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813439.393706:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813439.393711:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff70489c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.393720:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a80000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813439.393731:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff70489c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.393740:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff70489c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.393756:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff70489c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.393764:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff70489c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.393781:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.393782:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.393784:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813439.395721:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813439.395732:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac2889da/0xf32533d6ff7048a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.395748:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1788813439.395753:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813439.395759:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac2889da/0xf32533d6ff7048a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.395773:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac2889da/0xf32533d6ff7048a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.395783:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac2889da/0xf32533d6ff7048a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.395798:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac2889da/0xf32533d6ff7048a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.395818:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813439.395828:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813439.395834:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac2889da/0xf32533d6ff7048a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.395841:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a81600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813439.395845:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac2889da/0xf32533d6ff7048a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.395855:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac2889da/0xf32533d6ff7048a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.395870:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac2889da/0xf32533d6ff7048a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.395878:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac2889da/0xf32533d6ff7048a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.395893:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.395895:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.395896:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813439.397429:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813439.397446:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f339a6ab/0xf32533d6ff7048aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.397460:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1788813439.397464:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813439.397470:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f339a6ab/0xf32533d6ff7048aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.397483:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f339a6ab/0xf32533d6ff7048aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.397493:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f339a6ab/0xf32533d6ff7048aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.397500:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f339a6ab/0xf32533d6ff7048aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.397524:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813439.397755:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813439.397763:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f339a6ab/0xf32533d6ff7048aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.397771:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a80e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813439.397775:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f339a6ab/0xf32533d6ff7048aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.397784:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f339a6ab/0xf32533d6ff7048aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.397799:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f339a6ab/0xf32533d6ff7048aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.397807:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f339a6ab/0xf32533d6ff7048aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.397825:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813439.397827:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813439.397829:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813439.398406:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813439.398413:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff7048b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.398422:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1788813439.398426:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813439.398430:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff7048b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.398440:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff7048b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.398458:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff7048b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.398465:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff7048b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.398493:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813439.401759:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813439.401774:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff7048b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.401804:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a80000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813439.401810:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff7048b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.401822:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff7048b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.401846:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff7048b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.401854:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000695d7712/0xf32533d6ff7048b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.401880:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.401882:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.401884:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813439.403495:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.403505:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.403522:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.403526:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.403532:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.403545:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.403561:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.403569:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.403587:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813439.403598:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813439.403603:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.403611:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813439.403615:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.403623:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.403636:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.403643:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.403662:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.403669:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.403671:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813439.405661:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.405673:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.405689:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.405693:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.405699:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.405712:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.405722:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.405730:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.405749:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813439.405759:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813439.405764:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.405772:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813439.405776:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.405798:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.405813:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.405834:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.405853:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.405854:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.405856:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813439.411788:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813439.411804:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff7048c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.411823:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=592s v=(0 0) 00010000:00010000:1.0:1788813439.411835:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813439.411922:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff7048c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.411974:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff7048c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.411987:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff7048c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.411995:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff7048c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.412012:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813439.412260:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813439.412267:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff7048c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.412276:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dade00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813439.412281:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff7048c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.412291:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff7048c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.412307:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff7048c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.412328:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff7048c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.412358:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.412360:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.412362:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813439.414651:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813439.414664:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff7048cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.414681:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=592s v=(0 0) 00010000:00010000:1.0:1788813439.414685:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813439.414691:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff7048cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.414706:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff7048cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.414716:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff7048cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.414731:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff7048cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.414751:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813439.415384:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813439.415393:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff7048cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.415402:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813439.415407:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff7048cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.415416:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff7048cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.415580:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff7048cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.415589:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d31b543c/0xf32533d6ff7048cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.415607:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.415609:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.415611:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788813439.416163:0:25045:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1788813439.416187:0:25045:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788813439.416191:0:25045:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788813439.422295:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813439.422309:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff7048d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.422336:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1788813439.422340:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813439.422358:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff7048d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.422374:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff7048d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.422395:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff7048d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.422402:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff7048d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.422426:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813439.422499:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813439.422506:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff7048d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.422515:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813439.422519:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff7048d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.422528:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff7048d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.422548:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff7048d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.422555:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff7048d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.422572:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.422573:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.422575:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813439.423008:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813439.423015:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff7048db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.423023:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1788813439.423026:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1788813439.423027:0:24230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23467:x1875706313431808:12345-0@lo:5:osp-pre-1-1.0 Request processed in 60717us (60860us total) trans 12884901889 rc 0/0 00010000:00010000:0.0:1788813439.423030:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff7048db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813439.423040:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788813439.423040:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff7048db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.423047:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff7048db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.423053:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff7048db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813439.423104:0:23467:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788813439.423111:0:23467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23467:1875706313431808:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788813439.423127:0:23467:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1788813439.423176:0:23467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23467:1875706313431936:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788813439.423210:0:23467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813439.423236:0:23467:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082c00 going to sleep for 11 seconds 00010000:00010000:0.0:1788813439.423259:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813439.423268:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813439.423272:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff7048db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.423280:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdbc00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813439.423283:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff7048db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.423290:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff7048db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.423302:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff7048db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.423308:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff7048db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813439.423533:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313431936 00000100:00100000:3.0:1788813439.423540:0:22734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313431936 00000100:00100000:3.0:1788813439.423618:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813439.423627:0:22734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23467:x1875706313431936:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788813439.423679:0:22734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23467:x1875706313431936:12345-0@lo:900:osp-pre-1-1.0 Request processed in 53us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813439.423690:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788813439.423761:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.423763:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.423765:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788813439.423786:0:23467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489436e7800 x1875706313431936/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788813455 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813439.423797:0:23467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23467:1875706313431936:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788813439.424378:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813439.424385:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff7048e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.424396:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1788813439.424400:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813439.424405:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff7048e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.424416:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff7048e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.424561:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff7048e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.424569:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff7048e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.424583:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813439.424589:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813439.424596:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff7048e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.424603:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdae00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813439.424607:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff7048e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.424616:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff7048e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.424629:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff7048e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.424635:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff7048e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.424656:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.424658:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.424660:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813439.425114:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813439.425120:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff7048e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.425128:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1788813439.425131:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813439.425136:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff7048e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.425145:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff7048e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.425152:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff7048e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.425159:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff7048e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.425175:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813439.425196:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813439.425202:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff7048e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.425210:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813439.425214:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff7048e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.425222:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff7048e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.425233:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff7048e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.425240:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff7048e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.425253:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.425255:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.425257:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813439.425609:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.425615:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.425624:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.425627:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.425636:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.425647:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.425655:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.425663:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.425688:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813439.425820:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813439.425826:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.425835:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813439.425838:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.425846:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.426053:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.426060:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fba7a58/0xf32533d6ff7048f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813439.426076:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813439.426078:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813439.426080:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813439.426628:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.426634:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.426643:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.426646:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.426650:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.426659:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.426666:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.426682:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.426744:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788813439.427080:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.427086:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb60c7ec/0xf32533d6ff7048fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.427095:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.427098:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.427102:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb60c7ec/0xf32533d6ff7048fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.427111:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb60c7ec/0xf32533d6ff7048fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.427119:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb60c7ec/0xf32533d6ff7048fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.427126:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb60c7ec/0xf32533d6ff7048fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.427179:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788813439.427186:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.427194:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813439.427199:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.427207:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.427221:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.427228:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2498049/0xf32533d6ff7048f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.427243:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813439.427246:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb60c7ec/0xf32533d6ff7048fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.427252:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813439.427260:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb60c7ec/0xf32533d6ff7048fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.427267:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb60c7ec/0xf32533d6ff7048fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.427277:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb60c7ec/0xf32533d6ff7048fe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.427285:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.427287:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.427288:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.427357:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788813439.427362:0:24231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb60c7ec/0xf32533d6ff7048fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.427647:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813439.429728:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.429742:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000232a47af/0xf32533d6ff704905 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.429758:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.429762:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.429768:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000232a47af/0xf32533d6ff704905 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.429781:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000232a47af/0xf32533d6ff704905 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.429790:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000232a47af/0xf32533d6ff704905 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.429797:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000232a47af/0xf32533d6ff704905 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.429812:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788813439.430157:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.430167:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6d3b335/0xf32533d6ff70490c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.430180:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.430184:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.430193:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6d3b335/0xf32533d6ff70490c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.430202:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6d3b335/0xf32533d6ff70490c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.430209:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6d3b335/0xf32533d6ff70490c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.430215:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6d3b335/0xf32533d6ff70490c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.430232:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788813439.430809:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813439.430819:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000232a47af/0xf32533d6ff704905 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.430830:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813439.430835:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000232a47af/0xf32533d6ff704905 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.430856:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000232a47af/0xf32533d6ff704905 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.430873:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000232a47af/0xf32533d6ff704905 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.430880:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000232a47af/0xf32533d6ff704905 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.430899:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813439.430902:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6d3b335/0xf32533d6ff70490c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.430909:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813439.430912:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6d3b335/0xf32533d6ff70490c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.430925:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6d3b335/0xf32533d6ff70490c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.430965:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6d3b335/0xf32533d6ff70490c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.430971:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6d3b335/0xf32533d6ff70490c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.430996:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.430997:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.430999:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813439.431104:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.431110:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075d48277/0xf32533d6ff704913 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.431119:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.431121:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.431126:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075d48277/0xf32533d6ff704913 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.431135:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075d48277/0xf32533d6ff704913 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.431142:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075d48277/0xf32533d6ff704913 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.431157:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075d48277/0xf32533d6ff704913 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.431178:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813439.431514:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813439.431520:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075d48277/0xf32533d6ff704913 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.431527:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813439.431531:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075d48277/0xf32533d6ff704913 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.431539:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075d48277/0xf32533d6ff704913 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.431549:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075d48277/0xf32533d6ff704913 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.431555:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075d48277/0xf32533d6ff704913 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.431568:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.431569:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.431570:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813439.431641:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.431646:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ae5e7dd/0xf32533d6ff70491a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.431654:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.431657:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.431661:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ae5e7dd/0xf32533d6ff70491a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.431669:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ae5e7dd/0xf32533d6ff70491a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.431677:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ae5e7dd/0xf32533d6ff70491a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.431685:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ae5e7dd/0xf32533d6ff70491a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.431791:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813439.431921:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813439.431926:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ae5e7dd/0xf32533d6ff70491a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.433138:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813439.433144:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ae5e7dd/0xf32533d6ff70491a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.433153:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ae5e7dd/0xf32533d6ff70491a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.433169:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ae5e7dd/0xf32533d6ff70491a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.433176:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ae5e7dd/0xf32533d6ff70491a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.433195:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.433200:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.433203:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813439.433301:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.433307:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff704921 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.433362:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.433365:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.433370:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff704921 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.433381:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff704921 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.433389:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff704921 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.433396:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff704921 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.433416:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813439.433505:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813439.433511:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff704921 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.433592:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9800 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813439.433595:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff704921 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.433603:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff704921 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.433618:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff704921 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.433625:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff704921 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.433637:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.433638:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.433640:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813439.434296:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.434303:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eaaf884/0xf32533d6ff704928 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.434324:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.434327:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.434331:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eaaf884/0xf32533d6ff704928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.434341:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eaaf884/0xf32533d6ff704928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.434367:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eaaf884/0xf32533d6ff704928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.434374:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eaaf884/0xf32533d6ff704928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.434388:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813439.434396:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813439.434400:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eaaf884/0xf32533d6ff704928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.434406:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9c00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813439.434409:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eaaf884/0xf32533d6ff704928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.434416:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eaaf884/0xf32533d6ff704928 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.435151:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eaaf884/0xf32533d6ff704928 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.435160:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eaaf884/0xf32533d6ff704928 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.435179:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.435185:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.435188:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813439.436878:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.436888:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7d05aba/0xf32533d6ff70492f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.436903:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.436907:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.436912:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d05aba/0xf32533d6ff70492f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.436925:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7d05aba/0xf32533d6ff70492f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.436954:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7d05aba/0xf32533d6ff70492f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.436961:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d05aba/0xf32533d6ff70492f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.436984:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788813439.438100:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.438110:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff704936 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.438122:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.438126:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.438131:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff704936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.438151:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff704936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.438159:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff704936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.438166:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff704936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.438222:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788813439.438232:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813439.438237:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7d05aba/0xf32533d6ff70492f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.438244:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9a00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813439.438249:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7d05aba/0xf32533d6ff70492f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.438257:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7d05aba/0xf32533d6ff70492f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.438286:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813439.438292:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff704936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.438299:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813439.438302:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff704936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.438308:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff704936 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.438411:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff704936 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.438418:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff704936 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.439022:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7d05aba/0xf32533d6ff70492f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.439033:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7d05aba/0xf32533d6ff70492f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.439098:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.439100:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.439102:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.439283:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.439285:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813439.439289:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813439.440565:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.440573:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f337975/0xf32533d6ff70493d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.440586:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.440590:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.440595:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f337975/0xf32533d6ff70493d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.440608:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f337975/0xf32533d6ff70493d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.440616:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f337975/0xf32533d6ff70493d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.440622:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f337975/0xf32533d6ff70493d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.440647:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813439.441097:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813439.441104:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f337975/0xf32533d6ff70493d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.441112:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813439.441117:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f337975/0xf32533d6ff70493d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.441126:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f337975/0xf32533d6ff70493d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.441141:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f337975/0xf32533d6ff70493d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.441147:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f337975/0xf32533d6ff70493d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813439.441164:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.441165:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813439.441167:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.441704:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813439.441967:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.441974:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e062fa50/0xf32533d6ff704944 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.441994:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.441997:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.442000:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e062fa50/0xf32533d6ff704944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.442010:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e062fa50/0xf32533d6ff704944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.442015:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e062fa50/0xf32533d6ff704944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.442020:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e062fa50/0xf32533d6ff704944 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.442035:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813439.444733:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813439.444748:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e062fa50/0xf32533d6ff704944 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.444761:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08a00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813439.444765:0:23478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e062fa50/0xf32533d6ff704944 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.444776:0:23478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e062fa50/0xf32533d6ff704944 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.444798:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e062fa50/0xf32533d6ff704944 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.444823:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e062fa50/0xf32533d6ff704944 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.444848:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.444850:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.444852:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813439.445030:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.445036:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5138bbe/0xf32533d6ff70494b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.445044:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.445048:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.445052:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5138bbe/0xf32533d6ff70494b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.445061:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5138bbe/0xf32533d6ff70494b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.445074:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5138bbe/0xf32533d6ff70494b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.445079:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5138bbe/0xf32533d6ff70494b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.445095:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813439.445114:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813439.445119:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5138bbe/0xf32533d6ff70494b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.445126:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813439.445129:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5138bbe/0xf32533d6ff70494b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.445136:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5138bbe/0xf32533d6ff70494b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.445146:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5138bbe/0xf32533d6ff70494b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.445153:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5138bbe/0xf32533d6ff70494b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.445165:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.445166:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.445167:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813439.445538:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813439.445543:0:24231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041d34c6f/0xf32533d6ff704952 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.445550:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788813439.445552:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813439.445555:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041d34c6f/0xf32533d6ff704952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.445560:0:24231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041d34c6f/0xf32533d6ff704952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.445565:0:24231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041d34c6f/0xf32533d6ff704952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.445570:0:24231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041d34c6f/0xf32533d6ff704952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813439.445590:0:24231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813439.445613:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813439.445618:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041d34c6f/0xf32533d6ff704952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.445626:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09c00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813439.445629:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041d34c6f/0xf32533d6ff704952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.445638:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041d34c6f/0xf32533d6ff704952 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.445662:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041d34c6f/0xf32533d6ff704952 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.445669:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041d34c6f/0xf32533d6ff704952 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813439.445683:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.445685:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813439.445686:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788813439.445820:0:24231:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1788813439.445914:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22750:x1875706313431552:12345-0@lo:5:osp-pre-1-0.0 Request processed in 102179us (104100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813439.445924:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788813439.446003:0:22750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22750:1875706313431552:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788813439.446018:0:22750:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788813439.446055:0:22750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22750:1875706313432064:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788813439.446080:0:22750:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813439.446105:0:22750:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4634a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813439.446116:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313432064 00000100:00100000:2.0:1788813439.446122:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313432064 00000100:00100000:2.0:1788813439.446171:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788813439.446180:0:24228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22750:x1875706313432064:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788813439.446214:0:24228:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1788813439.448679:0:24228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22750:x1875706313432064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2493us (2590us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788813439.448692:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788813439.450663:0:22750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22750:1875706313432064:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788813439.450689:0:22750:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:3.0:1788813439.909233:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788813440.103243:0:23477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788813440.933136:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788813441.296379:0:25404:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788813441.956772:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788813442.669193:0:25456:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813442.669617:0:25456:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788813442.980919:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813443.432152:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313432192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813443.432255:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813443.432368:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313432192 00000100:00100000:3.0:1788813443.432379:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313432192 00000100:00100000:3.0:1788813443.432454:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813443.432466:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313432192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788813443.432506:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788813443.432560:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313432192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813443.432568:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788813443.432985:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813443.433548:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313432192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813443.433573:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813443.433659:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313432320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813443.433713:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813443.433766:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313432320 00000100:00100000:3.0:1788813443.433772:0:24233:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313432320 00000100:00100000:3.0:1788813443.433812:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788813443.433820:0:24233:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313432320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813443.433841:0:24233:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788813443.434414:0:24233:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313432320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813443.434426:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788813443.434450:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813443.434479:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313432320:0@lo:13:osp-pre-0-0.0 00000020:00000004:1.0:1788813443.827315:0:25506:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788813443.827581:0:25506:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788813444.010093:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813444.100903:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813444.101052:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301796352 00000100:00100000:2.0:1788813444.101063:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301796352 00000100:00100000:2.0:1788813444.101105:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 118 00000100:00100000:2.0:1788813444.101114:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7557a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2395:x1875706301796352:12345-192.168.202.13@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788813444.101141:0:22717:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 30ad7580-cbca-4182-959d-28f6755d6280@192.168.202.13@tcp t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:2.0:1788813444.101172:0:22717:0:(genops.c:1384:class_connect()) connect: client 30ad7580-cbca-4182-959d-28f6755d6280, cookie 0xf32533d6ff704959 00000100:00080000:2.0:1788813444.101355:0:22717:0:(import.c:65:import_set_state_nolock()) ffff9489433bc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813444.101529:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7557a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+5:2395:x1875706301796352:12345-192.168.202.13@tcp:250:mount.lustre.0 Request processed in 415us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813444.101538:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 118 00000100:00100000:1.0:1788813444.118046:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813444.118136:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301796480 00000100:00100000:0.0:1788813444.118147:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301796480 00000100:00100000:0.0:1788813444.118235:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 119 00000100:00100000:0.0:1788813444.118274:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a75578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+5:18077:x1875706301796480:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788813444.118292:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813444.118317:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cda000/0xf32533d6ff704960 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c77 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813444.118345:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cda000/0xf32533d6ff704960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c77 expref: 6 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813444.118355:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cda000/0xf32533d6ff704960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c77 expref: 6 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813444.118364:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cda000, rc 0) 00000100:00100000:0.0:1788813444.118419:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a75578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+6:18077:x1875706301796480:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 155us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813444.118425:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 119 00000100:00100000:1.0:1788813444.122926:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813444.123061:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301796608 00000100:00100000:2.0:1788813444.123071:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301796608 00000100:00100000:2.0:1788813444.123130:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 120 00000100:00100000:2.0:1788813444.123140:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7557a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+6:18077:x1875706301796608:12345-192.168.202.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788813444.123281:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7557a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+6:18077:x1875706301796608:12345-192.168.202.13@tcp:501:mount.lustre.0 Request processed in 133us (355us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788813444.123289:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 120 00000100:00100000:1.0:1788813444.134346:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813444.134843:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301796736 00000100:00100000:3.0:1788813444.134856:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301796736 00000100:00100000:3.0:1788813444.134916:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 121 00000100:00100000:3.0:1788813444.134927:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a75579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+6:18077:x1875706301796736:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788813444.134988:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813444.135018:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc09200/0xf32533d6ff704967 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c7e expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813444.135047:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc09200/0xf32533d6ff704967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c7e expref: 7 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813444.135059:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc09200/0xf32533d6ff704967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c7e expref: 7 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813444.135084:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09200, rc 0) 00000100:00100000:3.0:1788813444.135148:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a75579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+7:18077:x1875706301796736:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 223us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813444.135155:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 121 00000100:00100000:1.0:1788813444.143404:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813444.143484:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301796864 00000100:00100000:3.0:1788813444.143494:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301796864 00000100:00100000:3.0:1788813444.143553:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 122 00000100:00100000:3.0:1788813444.143563:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7557a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+7:18077:x1875706301796864:12345-192.168.202.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788813444.143727:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7557a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+8:18077:x1875706301796864:12345-192.168.202.13@tcp:501:mount.lustre.0 Request processed in 165us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813444.143735:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 122 00000100:00100000:2.0:1788813444.152321:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813444.152492:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301796992 00000100:00100000:1.0:1788813444.152502:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301796992 00000100:00100000:1.0:1788813444.152558:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 123 00000100:00100000:1.0:1788813444.152568:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7557b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+8:18077:x1875706301796992:12345-192.168.202.13@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788813444.152729:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7557b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+8:18077:x1875706301796992:12345-192.168.202.13@tcp:503:mount.lustre.0 Request processed in 161us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813444.152737:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 123 00000100:00100000:1.0:1788813444.161099:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813444.161525:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301797120 00000100:00100000:0.0:1788813444.161537:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301797120 00000100:00100000:0.0:1788813444.161594:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 124 00000100:00100000:0.0:1788813444.161603:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a75578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+8:18095:x1875706301797120:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813444.161781:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a75578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+8:18095:x1875706301797120:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 178us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813444.161789:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 124 00000100:00100000:2.0:1788813444.189425:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813444.189520:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301797248 00000100:00100000:3.0:1788813444.189532:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301797248 00000100:00100000:3.0:1788813444.189588:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 125 00000100:00100000:3.0:1788813444.189598:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7557b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+8:18095:x1875706301797248:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788813444.189821:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7557b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+8:18095:x1875706301797248:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 224us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813444.189829:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 125 00000100:00100000:2.0:1788813444.204673:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813444.204791:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301797376 00000100:00100000:1.0:1788813444.204801:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301797376 00000100:00100000:1.0:1788813444.204864:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 126 00000100:00100000:1.0:1788813444.204875:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7557bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+8:18095:x1875706301797376:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813444.205096:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7557bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+8:18095:x1875706301797376:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 222us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813444.205103:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 126 00000100:00100000:1.0:1788813444.222218:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813444.222446:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301797504 00000100:00100000:0.0:1788813444.222456:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301797504 00000100:00100000:0.0:1788813444.222519:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 127 00000100:00100000:0.0:1788813444.222530:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7557b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+8:18077:x1875706301797504:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788813444.222547:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813444.222579:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cdae00/0xf32533d6ff70496e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729caf expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813444.222609:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdae00/0xf32533d6ff70496e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729caf expref: 9 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813444.222621:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cdae00/0xf32533d6ff70496e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729caf expref: 9 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813444.222629:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdae00, rc 0) 00000100:00100000:0.0:1788813444.222701:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7557b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+9:18077:x1875706301797504:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 173us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813444.222708:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 127 00000100:00100000:1.0:1788813444.230323:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813444.230482:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301797632 00000100:00100000:3.0:1788813444.230493:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301797632 00000100:00100000:3.0:1788813444.230551:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 128 00000100:00100000:3.0:1788813444.230563:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+9:18077:x1875706301797632:12345-192.168.202.13@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788813444.230590:0:22716:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788813444.230609:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788813444.230617:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788813444.230620:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788813444.230623:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788813444.230626:0:22716:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788813444.254464:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+9:18077:x1875706301797632:12345-192.168.202.13@tcp:256:mount.lustre.0 Request processed in 23891us (24150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813444.254491:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 128 00000100:00100000:2.0:1788813444.260894:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813444.261874:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301797760 00000100:00100000:1.0:1788813444.261889:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301797760 00000100:00100000:1.0:1788813444.261993:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 129 00000100:00100000:1.0:1788813444.262175:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+9:18077:x1875706301797760:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788813444.262193:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813444.262210:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a43dac200/0xf32533d6ff704975 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729cb6 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813444.262239:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a43dac200/0xf32533d6ff704975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729cb6 expref: 10 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813444.262251:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a43dac200/0xf32533d6ff704975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729cb6 expref: 10 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813444.262259:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac200, rc 0) 00000100:00100000:1.0:1788813444.262483:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+10:18077:x1875706301797760:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 481us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813444.262492:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 129 00000100:00100000:1.0:1788813444.277605:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813444.278678:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301797888 00000100:00100000:2.0:1788813444.278691:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301797888 00000100:00100000:2.0:1788813444.278817:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 130 00000100:00100000:2.0:1788813444.278829:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+10:18077:x1875706301797888:12345-192.168.202.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788813444.279064:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+10:18077:x1875706301797888:12345-192.168.202.13@tcp:501:mount.lustre.0 Request processed in 237us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813444.279072:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 130 00000100:00100000:0.0:1788813444.282421:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813444.282561:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301798016 00000100:00100000:1.0:1788813444.282571:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301798016 00000100:00100000:1.0:1788813444.282625:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 131 00000100:00100000:1.0:1788813444.282635:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+10:18077:x1875706301798016:12345-192.168.202.13@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788813444.282801:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+10:18077:x1875706301798016:12345-192.168.202.13@tcp:503:mount.lustre.0 Request processed in 167us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813444.282810:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 131 00000100:00100000:3.0:1788813444.288097:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813444.288320:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301798144 00000100:00100000:2.0:1788813444.288330:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301798144 00000100:00100000:2.0:1788813444.288391:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 132 00000100:00100000:2.0:1788813444.288402:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+10:18101:x1875706301798144:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813444.288562:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+10:18101:x1875706301798144:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 162us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813444.288569:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 132 00000100:00100000:2.0:1788813444.298700:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813444.298802:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301798272 00000100:00100000:0.0:1788813444.298813:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301798272 00000100:00100000:0.0:1788813444.298870:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 133 00000100:00100000:0.0:1788813444.298880:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+10:18101:x1875706301798272:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813444.299114:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+10:18101:x1875706301798272:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 235us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813444.299122:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 133 00000100:00100000:0.0:1788813444.319197:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813444.319482:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000040:00080000:2.0:1788813444.327062:0:22759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788813444.333611:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301798400 00000100:00100000:3.0:1788813444.333665:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301798400 00000100:00100000:3.0:1788813444.340834:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301798656 00000100:00100000:3.0:1788813444.340850:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301798656 00000100:00100000:3.0:1788813444.340896:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:3.0:1788813444.340905:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1875706301798400:12345-192.168.202.13@tcp:38:mount.lustre.0 00000100:00100000:1.0:1788813444.341013:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:1.0:1788813444.341043:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1875706301798656:12345-192.168.202.13@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788813444.341077:0:25305:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 7492b028-cad1-4968-b6ea-0072cb2dae48@192.168.202.13@tcp t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:1.0:1788813444.341149:0:25305:0:(genops.c:1384:class_connect()) connect: client 7492b028-cad1-4968-b6ea-0072cb2dae48, cookie 0xf32533d6ff70497c 00000004:00100000:1.0:1788813444.341176:0:25305:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788813444.342404:0:25305:0:(import.c:65:import_set_state_nolock()) ffff948942c7f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813444.342493:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+6:2395:x1875706301798656:12345-192.168.202.13@tcp:38:mount.lustre.0 Request processed in 1448us (23017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813444.342502:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 8 00010000:00080000:3.0:1788813444.357799:0:22724:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7492b028-cad1-4968-b6ea-0072cb2dae48@192.168.202.13@tcp t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:3.0:1788813444.357864:0:22724:0:(genops.c:1384:class_connect()) connect: client 7492b028-cad1-4968-b6ea-0072cb2dae48, cookie 0xf32533d6ff704983 00000004:00100000:3.0:1788813444.357891:0:22724:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788813444.358216:0:22724:0:(import.c:65:import_set_state_nolock()) ffff948941ae2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813444.358338:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+6:2395:x1875706301798400:12345-192.168.202.13@tcp:38:mount.lustre.0 Request processed in 17431us (39151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813444.358348:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:1.0:1788813444.365490:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813444.365618:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301798784 00000100:00100000:2.0:1788813444.365629:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301798784 00000100:00100000:2.0:1788813444.365715:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:2.0:1788813444.365726:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+6:0:x1875706301798784:12345-192.168.202.13@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788813444.365764:0:25305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788813444.365897:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+6:0:x1875706301798784:12345-192.168.202.13@tcp:41:mount.lustre.0 Request processed in 173us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813444.365921:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00080000:3.0:1788813444.366029:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788813444.398556:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813444.398654:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301798912 00000100:00100000:3.0:1788813444.398665:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301798912 00000100:00100000:3.0:1788813444.398748:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:3.0:1788813444.398759:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+6:18077:x1875706301798912:12345-192.168.202.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788813444.398796:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788813444.398897:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+6:18077:x1875706301798912:12345-192.168.202.13@tcp:41:mount.lustre.0 Request processed in 140us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813444.398905:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00080000:1.0:1788813444.399037:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813444.401862:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813444.402021:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301798528 00000100:00100000:2.0:1788813444.402038:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301798528 00000100:00100000:2.0:1788813444.402099:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:2.0:1788813444.402109:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+6:0:x1875706301798528:12345-192.168.202.13@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788813444.402138:0:25305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788813444.402216:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+6:0:x1875706301798528:12345-192.168.202.13@tcp:41:mount.lustre.0 Request processed in 108us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813444.402224:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:2.0:1788813444.413202:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813444.416279:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301799040 00000100:00100000:3.0:1788813444.416296:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301799040 00000100:00100000:2.0:1788813444.416542:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12 00000100:00100000:2.0:1788813444.416554:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+6:18077:x1875706301799040:12345-192.168.202.13@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788813444.416661:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+6:18077:x1875706301799040:12345-192.168.202.13@tcp:40:mount.lustre.0 Request processed in 110us (3469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813444.416669:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12 00000100:00100000:3.0:1788813444.419394:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813444.419438:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813444.419471:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813444.419602:0:24816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301799168 00000100:00100000:1.0:1788813444.419613:0:24816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301799168 00000100:00100000:1.0:1788813444.419651:0:24816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301799296 00000100:00100000:1.0:1788813444.419653:0:24816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301799296 00000100:00100000:1.0:1788813444.419667:0:24816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:1.0:1788813444.419675:0:24816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2395:x1875706301799168:12345-192.168.202.13@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788813444.419747:0:24816:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7492b028-cad1-4968-b6ea-0072cb2dae48@192.168.202.13@tcp t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:1.0:1788813444.419783:0:24816:0:(genops.c:1384:class_connect()) connect: client 7492b028-cad1-4968-b6ea-0072cb2dae48, cookie 0xf32533d6ff70498a 00002000:00100000:1.0:1788813444.419793:0:24816:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7492b028-cad1-4968-b6ea-0072cb2dae48/ffff948942c7c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788813444.419803:0:24816:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788813444.420018:0:24816:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788813444.420048:0:24816:0:(import.c:65:import_set_state_nolock()) ffff948942c7a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813444.420106:0:24816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+6:2395:x1875706301799168:12345-192.168.202.13@tcp:8:mount.lustre.0 Request processed in 431us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813444.420113:0:24816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:1.0:1788813444.420141:0:24816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:1.0:1788813444.420146:0:24816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2395:x1875706301799296:12345-192.168.202.13@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788813444.420162:0:24816:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7492b028-cad1-4968-b6ea-0072cb2dae48@192.168.202.13@tcp t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:1.0:1788813444.420178:0:24816:0:(genops.c:1384:class_connect()) connect: client 7492b028-cad1-4968-b6ea-0072cb2dae48, cookie 0xf32533d6ff704991 00002000:00100000:1.0:1788813444.420182:0:24816:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7492b028-cad1-4968-b6ea-0072cb2dae48/ffff948a74aa1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788813444.420194:0:24816:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788813444.420324:0:24816:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788813444.420339:0:24816:0:(import.c:65:import_set_state_nolock()) ffff948a74aa1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813444.420363:0:24816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+6:2395:x1875706301799296:12345-192.168.202.13@tcp:8:mount.lustre.0 Request processed in 215us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813444.420370:0:24816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:0.0:1788813444.420646:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301799424 00000100:00100000:0.0:1788813444.420653:0:22734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301799424 00000100:00100000:0.0:1788813444.420693:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:0.0:1788813444.420700:0:22734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7492b028-cad1-4968-b6ea-0072cb2dae48+6:18077:x1875706301799424:12345-192.168.202.13@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788813444.420747:0:22734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7492b028-cad1-4968-b6ea-0072cb2dae48+6:18077:x1875706301799424:12345-192.168.202.13@tcp:900:mount.lustre.0 Request processed in 47us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813444.420754:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:3.0:1788813444.425073:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813444.425500:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301799552 00000100:00100000:1.0:1788813444.425512:0:22726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301799552 00000100:00100000:1.0:1788813444.425574:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:1.0:1788813444.425585:0:22726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+6:18077:x1875706301799552:12345-192.168.202.13@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788813444.431330:0:22726:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5602us 00000001:00100000:0.0:1788813444.435413:0:25045:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7492b028-cad1-4968-b6ea-0072cb2dae48 00000001:00080000:0.0:1788813444.435432:0:25045:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000004:00200000:1.0:1788813444.452855:0:22726:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788813444.453046:0:22726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+6:18077:x1875706301799552:12345-192.168.202.13@tcp:33:mount.lustre.0 Request processed in 27458us (27980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813444.453057:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:2.0:1788813444.480570:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313432576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813444.480671:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813444.480730:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813444.480736:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313432448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813444.480761:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813444.481066:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313432576 00000100:00100000:0.0:1788813444.481074:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313432576 00000100:00100000:0.0:1788813444.481117:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313432448 00000100:00100000:0.0:1788813444.481121:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313432448 00000100:00100000:0.0:1788813444.481139:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788813444.481149:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313432576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813444.481177:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788813444.481229:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313432576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813444.481236:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788813444.481252:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788813444.481258:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313432448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788813444.481282:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788813444.481320:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313432448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813444.481325:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788813444.481462:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313433088:0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.481491:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813444.481511:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313433600:0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.481533:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813444.481569:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313434112:0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.481590:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813444.481626:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313432448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813444.481640:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313432576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813444.481664:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788813444.481672:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313432960:0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.481694:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813444.481710:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313433472:0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.481729:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813444.481744:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313433984:0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.481767:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813444.482368:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:151fd599-5695-4163-8caa-7faa559323aa:3628:1875706313432832:0@lo:400:kworker.0 00000100:00100000:2.0:1788813444.482412:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813444.482438:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313433344:0@lo:400:kworker.0 00000100:00100000:2.0:1788813444.482457:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813444.482475:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313433856:0@lo:400:kworker.0 00000100:00100000:2.0:1788813444.482494:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813444.482513:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788813444.482518:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313432704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813444.482569:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813444.482589:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313433216:0@lo:400:kworker.0 00000100:00100000:2.0:1788813444.482608:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813444.482618:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313433728:0@lo:400:kworker.0 00000100:00100000:2.0:1788813444.482636:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813444.482669:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313433088 00000100:00100000:2.0:1788813444.482675:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313433088 00000100:00100000:2.0:1788813444.482719:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313432960 00000100:00100000:2.0:1788813444.482722:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313432960 00000100:00100000:2.0:1788813444.482735:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313433472 00000100:00100000:2.0:1788813444.482737:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313433472 00000100:00100000:2.0:1788813444.482750:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313433344 00000100:00100000:2.0:1788813444.482752:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313433344 00000100:00100000:2.0:1788813444.482765:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813444.482771:0:24230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313433088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813444.482818:0:24230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313433088:12345-0@lo:400:kworker.0 Request processed in 47us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813444.482825:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813444.482839:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788813444.482845:0:24230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313432960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.483232:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313433600 00000100:00100000:0.0:1788813444.483238:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313433600 00000100:00100000:0.0:1788813444.483259:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313434112 00000100:00100000:0.0:1788813444.483262:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313434112 00000100:00100000:0.0:1788813444.483276:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313433984 00000100:00100000:0.0:1788813444.483278:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313433984 00000100:00100000:0.0:1788813444.483291:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313433856 00000100:00100000:0.0:1788813444.483294:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313433856 00000100:00100000:0.0:1788813444.483320:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313433216 00000100:00100000:0.0:1788813444.483323:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313433216 00000100:00100000:0.0:1788813444.483334:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313433728 00000100:00100000:0.0:1788813444.483336:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313433728 00000100:00100000:0.0:1788813444.483352:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813444.483358:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313433600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.483394:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313433600:12345-0@lo:400:kworker.0 Request processed in 37us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813444.483400:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813444.483419:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788813444.483425:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313434112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.483452:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313434112:12345-0@lo:400:kworker.0 Request processed in 28us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813444.483458:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788813444.483467:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788813444.483472:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313433984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.483494:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313433984:12345-0@lo:400:kworker.0 Request processed in 22us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813444.483500:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788813444.483509:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788813444.483515:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313433856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.483546:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313433856:12345-0@lo:400:kworker.0 Request processed in 31us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813444.483551:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788813444.483562:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788813444.483567:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313433216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.483592:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313433216:12345-0@lo:400:kworker.0 Request processed in 25us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813444.483598:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788813444.483607:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788813444.483613:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313433728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.483637:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313433728:12345-0@lo:400:kworker.0 Request processed in 24us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813444.483642:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788813444.483773:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489433a7100 x1875706313433984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813444.483787:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313433984:0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.483798:0:3626:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788813444.483812:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313433088:0@lo:400:kworker.0 00010000:00080000:0.0:1788813444.483822:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489436e7b80 x1875706313433600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813444.483831:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313433600:0@lo:400:kworker.0 00010000:00080000:0.0:1788813444.483841:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489433a4a80 x1875706313434112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813444.483848:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313434112:0@lo:400:kworker.0 00000100:00100000:1.0:1788813444.484132:0:24816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813444.484144:0:24816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313433472:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788813444.484328:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489436e5f80 x1875706313433216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813444.484339:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313433216:0@lo:400:kworker.0 00000100:00100000:2.0:1788813444.484389:0:24230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313432960:12345-0@lo:400:kworker.0 Request processed in 1542us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813444.484396:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788813444.484414:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813444.484421:0:24230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313433344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813444.484456:0:24230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313433344:12345-0@lo:400:kworker.0 Request processed in 36us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813444.484461:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813444.484472:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313432704 00000100:00100000:3.0:1788813444.484477:0:24233:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313432704 00000100:00100000:3.0:1788813444.484671:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813444.484679:0:24233:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3628:x1875706313432704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788813444.484696:0:24233:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788813444.484735:0:24233:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3628:x1875706313432704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (2165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813444.484741:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788813444.487220:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489436e6680 x1875706313433728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813444.487238:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313433728:0@lo:400:kworker.0 00000100:00100000:1.0:1788813444.491529:0:24816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313433472:12345-0@lo:400:kworker.0 Request processed in 7378us (9787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813444.491546:0:24816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813444.491598:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313432832 00000100:00100000:1.0:1788813444.491620:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313432832 00000100:00100000:1.0:1788813444.491670:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788813444.491679:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+24:3628:x1875706313432832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813444.491731:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+24:3628:x1875706313432832:12345-0@lo:400:kworker.0 Request processed in 54us (9318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813444.491738:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1788813444.491771:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813444.491777:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788813444.491781:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813444.491799:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313434240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813444.492042:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313433344:0@lo:400:kworker.0 00010000:00080000:0.0:1788813444.492061:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489433a5500 x1875706313433856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813444.492071:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313433856:0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.492134:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313432704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813444.492145:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:151fd599-5695-4163-8caa-7faa559323aa:3628:1875706313432832:0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.492202:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313432960:0@lo:400:kworker.0 00000100:00100000:0.0:1788813444.492211:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313433472:0@lo:400:kworker.0 00000100:00100000:1.0:1788813444.493462:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813444.495635:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313434240 00000100:00100000:3.0:1788813444.495648:0:24233:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313434240 00000100:00100000:3.0:1788813444.495705:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813444.495715:0:24233:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313434240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813444.495740:0:24233:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788813444.495822:0:24233:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313434240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (2365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813444.495836:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813444.495927:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313434240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813444.612612:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813444.612796:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301799680 00000100:00100000:0.0:1788813444.612808:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301799680 00000100:00100000:0.0:1788813444.612881:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:0.0:1788813444.612893:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+6:18124:x1875706301799680:12345-192.168.202.13@tcp:101:mkdir.0 00010000:00010000:0.0:1788813444.612913:0:25305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813444.613026:0:25305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704998 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729ce7 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813444.613092:0:25305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff70499f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813444.613106:0:25305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff70499f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813444.613121:0:25305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff70499f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813444.613172:0:25305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788813444.613176:0:25305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813444.613211:0:25305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff70499f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813444.613237:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704998 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ce7 expref: 8 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813444.613273:0:25305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff70499f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ce7 expref: 7 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813444.613283:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6e8e4900) 00010000:00010000:0.0:1788813444.613286:0:25305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813444.613290:0:25305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cda600, rc 0) 00000100:00100000:0.0:1788813444.613362:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+7:18124:x1875706301799680:12345-192.168.202.13@tcp:101:mkdir.0 Request processed in 471us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813444.613369:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13 00010000:00010000:2.0:1788813445.028204:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813446.055573:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813446.524515:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813446.525925:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301799808 00000100:00100000:0.0:1788813446.525951:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301799808 00000100:00100000:0.0:1788813446.526107:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00100000:0.0:1788813446.526134:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+7:18177:x1875706301799808:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:0.0:1788813446.526185:0:22724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788813446.526714:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+7:18177:x1875706301799808:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 594us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813446.526723:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00080000:1.0:1788813446.526958:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813446.532618:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813446.534458:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301799936 00000100:00100000:2.0:1788813446.534475:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301799936 00000100:00100000:2.0:1788813446.534636:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:2.0:1788813446.534649:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+6:18177:x1875706301799936:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:2.0:1788813446.534712:0:22725:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788813446.534836:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+6:18177:x1875706301799936:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 190us (2227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813446.534843:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:3.0:1788813446.542090:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813446.542187:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301800064 00000100:00100000:0.0:1788813446.542197:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301800064 00000100:00080000:1.0:1788813446.543084:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813446.543092:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813446.543128:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:0.0:1788813446.543142:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7492b028-cad1-4968-b6ea-0072cb2dae48+6:18177:x1875706301800064:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:0.0:1788813446.543210:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788813446.543308:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7492b028-cad1-4968-b6ea-0072cb2dae48+6:18177:x1875706301800064:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 170us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813446.543316:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:0.0:1788813446.549182:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813446.549924:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301800192 00000100:00100000:3.0:1788813446.549983:0:24233:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301800192 00000100:00100000:3.0:1788813446.550078:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00100000:3.0:1788813446.550108:0:24233:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7492b028-cad1-4968-b6ea-0072cb2dae48+5:18177:x1875706301800192:12345-192.168.202.13@tcp:13:lfs.0 00000100:00080000:1.0:1788813446.550120:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1788813446.550152:0:24233:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788813446.550257:0:24233:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7492b028-cad1-4968-b6ea-0072cb2dae48+5:18177:x1875706301800192:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 151us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813446.550265:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00100000:3.0:1788813446.681856:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813446.684043:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301800320 00000100:00100000:2.0:1788813446.684063:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301800320 00000100:00100000:2.0:1788813446.684145:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 135 00000100:00100000:2.0:1788813446.684156:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+10:18212:x1875706301800320:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788813446.684174:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813446.684193:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948941a80000/0xf32533d6ff7049a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729cee expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813446.684222:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948941a80000/0xf32533d6ff7049a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729cee expref: 11 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813446.684246:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948941a80000/0xf32533d6ff7049a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729cee expref: 11 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813446.684255:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948941a80000, rc 0) 00000100:00100000:2.0:1788813446.684568:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+11:18212:x1875706301800320:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 411us (2725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813446.684575:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 135 00000100:00100000:1.0:1788813446.698223:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813446.698502:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301800448 00000100:00100000:3.0:1788813446.698515:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301800448 00000100:00100000:3.0:1788813446.698580:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 136 00000100:00100000:3.0:1788813446.698591:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a463afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+11:18212:x1875706301800448:12345-192.168.202.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788813446.698789:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a463afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+11:18212:x1875706301800448:12345-192.168.202.13@tcp:501:mount.lustre.0 Request processed in 199us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813446.698796:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 136 00000100:00100000:0.0:1788813446.703040:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813446.703177:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301800576 00000100:00100000:2.0:1788813446.703188:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301800576 00000100:00100000:2.0:1788813446.703248:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 137 00000100:00100000:2.0:1788813446.703259:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+11:18212:x1875706301800576:12345-192.168.202.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788813446.703637:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+11:18212:x1875706301800576:12345-192.168.202.13@tcp:503:mount.lustre.0 Request processed in 378us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813446.703647:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 137 00000100:00100000:2.0:1788813446.717479:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813446.718104:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301800704 00000100:00100000:1.0:1788813446.718118:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301800704 00000100:00100000:1.0:1788813446.718177:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 138 00000100:00100000:1.0:1788813446.718188:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+11:18216:x1875706301800704:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813446.719528:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+11:18216:x1875706301800704:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 1335us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813446.719540:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 138 00000100:00100000:1.0:1788813446.736180:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813446.736336:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301800832 00000100:00100000:2.0:1788813446.736347:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301800832 00000100:00100000:2.0:1788813446.736414:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 139 00000100:00100000:2.0:1788813446.736425:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+11:18216:x1875706301800832:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813446.736608:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+11:18216:x1875706301800832:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 185us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813446.736616:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 139 00000100:00100000:0.0:1788813446.740159:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813446.741713:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301800960 00000100:00100000:1.0:1788813446.741726:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301800960 00000100:00100000:1.0:1788813446.741802:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 140 00000100:00100000:1.0:1788813446.741813:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+11:18216:x1875706301800960:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813446.742014:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+11:18216:x1875706301800960:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 202us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813446.742023:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 140 00000100:00100000:0.0:1788813446.755767:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813446.756353:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301801088 00000100:00100000:3.0:1788813446.756366:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301801088 00000100:00100000:3.0:1788813446.756430:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 141 00000100:00100000:3.0:1788813446.756441:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+11:18212:x1875706301801088:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788813446.756459:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813446.756479:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc09a00/0xf32533d6ff7049ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729d1f expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813446.756507:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc09a00/0xf32533d6ff7049ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d1f expref: 12 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813446.756519:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc09a00/0xf32533d6ff7049ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d1f expref: 12 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813446.756546:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09a00, rc 0) 00000100:00100000:3.0:1788813446.756612:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+12:18212:x1875706301801088:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 172us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813446.756619:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 141 00000100:00100000:3.0:1788813446.768892:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813446.775293:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301801216 00000100:00100000:2.0:1788813446.775311:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301801216 00000100:00100000:2.0:1788813446.775399:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 142 00000100:00100000:2.0:1788813446.775427:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+12:18212:x1875706301801216:12345-192.168.202.13@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788813446.775457:0:22716:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788813446.775490:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788813446.775495:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788813446.775498:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788813446.775501:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788813446.775504:0:22716:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788813446.791649:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+12:18212:x1875706301801216:12345-192.168.202.13@tcp:256:mount.lustre.0 Request processed in 16214us (22760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813446.791675:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 142 00000100:00100000:2.0:1788813446.808593:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813446.808785:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301801344 00000100:00100000:1.0:1788813446.808802:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301801344 00000100:00100000:1.0:1788813446.808886:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 143 00000100:00100000:1.0:1788813446.808899:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+12:18212:x1875706301801344:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788813446.808927:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813446.808998:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a43dade00/0xf32533d6ff7049b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729d26 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813446.809052:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a43dade00/0xf32533d6ff7049b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d26 expref: 13 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813446.809069:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a43dade00/0xf32533d6ff7049b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d26 expref: 13 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813446.809081:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dade00, rc 0) 00000100:00100000:1.0:1788813446.809170:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+13:18212:x1875706301801344:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 274us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813446.809206:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 143 00000100:00100000:0.0:1788813446.811502:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813446.811592:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301801472 00000100:00100000:1.0:1788813446.811605:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301801472 00000100:00100000:1.0:1788813446.811719:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 144 00000100:00100000:1.0:1788813446.811730:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+13:18212:x1875706301801472:12345-192.168.202.13@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788813446.811964:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+13:18212:x1875706301801472:12345-192.168.202.13@tcp:501:mount.lustre.0 Request processed in 201us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813446.811973:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 144 00000100:00100000:2.0:1788813446.813914:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813446.814073:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301801600 00000100:00100000:0.0:1788813446.814085:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301801600 00000100:00100000:1.0:1788813446.814428:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 145 00000100:00100000:1.0:1788813446.814448:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+13:18212:x1875706301801600:12345-192.168.202.13@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788813446.814639:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+13:18212:x1875706301801600:12345-192.168.202.13@tcp:503:mount.lustre.0 Request processed in 197us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813446.814657:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 145 00000100:00100000:3.0:1788813446.817854:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813446.818423:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301801728 00000100:00100000:1.0:1788813446.818441:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301801728 00000100:00100000:1.0:1788813446.818534:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 146 00000100:00100000:1.0:1788813446.818551:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+13:18221:x1875706301801728:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813446.818779:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+13:18221:x1875706301801728:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 232us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813446.818788:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 146 00000100:00100000:1.0:1788813446.822799:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813446.823011:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301801856 00000100:00100000:3.0:1788813446.823033:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301801856 00000100:00100000:3.0:1788813446.823105:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 147 00000100:00100000:3.0:1788813446.823119:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+13:18221:x1875706301801856:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788813446.823767:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+13:18221:x1875706301801856:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 647us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813446.823779:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 147 00000100:00100000:0.0:1788813446.837043:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813446.837119:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813446.839793:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301801984 00000100:00100000:2.0:1788813446.839816:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301801984 00000100:00100000:2.0:1788813446.839957:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301802240 00000100:00100000:2.0:1788813446.839961:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301802240 00000100:00100000:2.0:1788813446.840010:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:2.0:1788813446.840022:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1875706301801984:12345-192.168.202.13@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788813446.840071:0:22723:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 2f9ee3c2-14b6-4a7b-b263-f7a09903dc59@192.168.202.13@tcp t0 exp 0000000000000000 cur 599 last 0 00000020:00000080:2.0:1788813446.840129:0:22723:0:(genops.c:1384:class_connect()) connect: client 2f9ee3c2-14b6-4a7b-b263-f7a09903dc59, cookie 0xf32533d6ff7049bb 00000004:00100000:2.0:1788813446.840166:0:22723:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788813446.840331:0:22723:0:(import.c:65:import_set_state_nolock()) ffff948a7d6c9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813446.840451:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:2395:x1875706301801984:12345-192.168.202.13@tcp:38:mount.lustre.0 Request processed in 430us (3423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813446.840461:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:2.0:1788813446.840506:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:2.0:1788813446.840511:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1875706301802240:12345-192.168.202.13@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788813446.840529:0:22723:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 2f9ee3c2-14b6-4a7b-b263-f7a09903dc59@192.168.202.13@tcp t0 exp 0000000000000000 cur 599 last 0 00000020:00000080:2.0:1788813446.840560:0:22723:0:(genops.c:1384:class_connect()) connect: client 2f9ee3c2-14b6-4a7b-b263-f7a09903dc59, cookie 0xf32533d6ff7049c2 00000004:00100000:2.0:1788813446.840590:0:22723:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788813446.840639:0:22723:0:(import.c:65:import_set_state_nolock()) ffff948a7d6c8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813446.840662:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:2395:x1875706301802240:12345-192.168.202.13@tcp:38:mount.lustre.0 Request processed in 149us (3543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813446.840669:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:2.0:1788813446.849419:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813446.849462:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813446.849659:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301802112 00000100:00100000:0.0:1788813446.849675:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301802112 00000100:00100000:0.0:1788813446.849851:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301802496 00000100:00100000:0.0:1788813446.849855:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301802496 00000100:00100000:0.0:1788813446.849892:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:0.0:1788813446.849905:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+7:0:x1875706301802112:12345-192.168.202.13@tcp:41:mount.lustre.0 00000100:00100000:3.0:1788813446.850043:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00100000:3.0:1788813446.850054:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+7:18212:x1875706301802496:12345-192.168.202.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788813446.850219:0:25305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00080000:2.0:1788813446.850243:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813446.850413:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+7:18212:x1875706301802496:12345-192.168.202.13@tcp:41:mount.lustre.0 Request processed in 359us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813446.850423:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 19 00000004:00000024:0.0:1788813446.850469:0:22725:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788813446.850504:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:0:x1875706301802112:12345-192.168.202.13@tcp:41:mount.lustre.0 Request processed in 602us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813446.850512:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:3.0:1788813446.851327:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813446.851433:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301802368 00000100:00100000:0.0:1788813446.851441:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301802368 00000100:00100000:0.0:1788813446.851511:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:0.0:1788813446.851520:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:0:x1875706301802368:12345-192.168.202.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788813446.851621:0:22724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788813446.851690:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:0:x1875706301802368:12345-192.168.202.13@tcp:41:mount.lustre.0 Request processed in 170us (367us total) trans 0 rc 0/0 00000100:00080000:2.0:1788813446.851714:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813446.852152:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:2.0:1788813446.856655:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813446.856905:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301802624 00000100:00100000:0.0:1788813446.856919:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301802624 00000100:00100000:1.0:1788813446.857127:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:1.0:1788813446.857147:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:18212:x1875706301802624:12345-192.168.202.13@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788813446.857398:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:18212:x1875706301802624:12345-192.168.202.13@tcp:40:mount.lustre.0 Request processed in 259us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813446.857407:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:3.0:1788813446.859696:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813446.860297:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813446.860340:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813446.860380:0:25304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301802752 00000100:00100000:1.0:1788813446.860394:0:25304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301802752 00000100:00100000:1.0:1788813446.860455:0:25304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301802880 00000100:00100000:1.0:1788813446.860458:0:25304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301802880 00000100:00100000:1.0:1788813446.860487:0:25304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:1.0:1788813446.860497:0:25304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2395:x1875706301802752:12345-192.168.202.13@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788813446.860545:0:25304:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2f9ee3c2-14b6-4a7b-b263-f7a09903dc59@192.168.202.13@tcp t0 exp 0000000000000000 cur 599 last 0 00000020:00000080:1.0:1788813446.860620:0:25304:0:(genops.c:1384:class_connect()) connect: client 2f9ee3c2-14b6-4a7b-b263-f7a09903dc59, cookie 0xf32533d6ff7049c9 00002000:00100000:1.0:1788813446.860635:0:25304:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2f9ee3c2-14b6-4a7b-b263-f7a09903dc59/ffff948a7d662800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788813446.860649:0:25304:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788813446.860843:0:25304:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788813446.860886:0:25304:0:(import.c:65:import_set_state_nolock()) ffff948a7d664800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813446.860993:0:25304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:2395:x1875706301802752:12345-192.168.202.13@tcp:8:mount.lustre.0 Request processed in 495us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813446.861003:0:25304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:1.0:1788813446.861308:0:25304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:1.0:1788813446.861318:0:25304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2395:x1875706301802880:12345-192.168.202.13@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788813446.861366:0:25304:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 2f9ee3c2-14b6-4a7b-b263-f7a09903dc59@192.168.202.13@tcp t0 exp 0000000000000000 cur 599 last 0 00000020:00000080:1.0:1788813446.861394:0:25304:0:(genops.c:1384:class_connect()) connect: client 2f9ee3c2-14b6-4a7b-b263-f7a09903dc59, cookie 0xf32533d6ff7049d0 00002000:00100000:1.0:1788813446.861406:0:25304:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2f9ee3c2-14b6-4a7b-b263-f7a09903dc59/ffff948a7d663800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788813446.861417:0:25304:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788813446.861494:0:25304:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788813446.861511:0:25304:0:(import.c:65:import_set_state_nolock()) ffff948a7d660800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813446.861538:0:25304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:2395:x1875706301802880:12345-192.168.202.13@tcp:8:mount.lustre.0 Request processed in 220us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813446.861544:0:25304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:0.0:1788813446.866272:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301803008 00000100:00100000:0.0:1788813446.866298:0:22734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301803008 00000100:00100000:0.0:1788813446.866400:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4 00000100:00100000:0.0:1788813446.866412:0:22734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:18212:x1875706301803008:12345-192.168.202.13@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788813446.866521:0:22734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:18212:x1875706301803008:12345-192.168.202.13@tcp:900:mount.lustre.0 Request processed in 111us (6843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813446.866529:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4 00000100:00100000:3.0:1788813446.870585:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813446.870686:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301803136 00000100:00100000:1.0:1788813446.870694:0:22727:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301803136 00000100:00100000:1.0:1788813446.870737:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 1 00000100:00100000:1.0:1788813446.870747:0:22727:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:18212:x1875706301803136:12345-192.168.202.13@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788813446.870831:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788813446.870909:0:22727:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:18212:x1875706301803136:12345-192.168.202.13@tcp:33:mount.lustre.0 Request processed in 164us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813446.870916:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 1 00000100:00100000:2.0:1788813446.993653:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813446.995107:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301803264 00000100:00100000:1.0:1788813446.995126:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301803264 00000100:00100000:1.0:1788813446.995318:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:1.0:1788813446.995332:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:18244:x1875706301803264:12345-192.168.202.13@tcp:101:mkdir.0 00010000:00010000:1.0:1788813446.995360:0:25305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813446.995526:0:25305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff7049d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729d57 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813446.995623:0:25305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7049de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813446.995639:0:25305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7049de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813446.995662:0:25305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7049de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813446.995722:0:25305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788813446.995726:0:25305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788813446.995749:0:25305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7049de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813446.995792:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff7049d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d57 expref: 8 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813446.995818:0:25305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7049de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d57 expref: 7 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813446.995826:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6e8e4900) 00010000:00010000:1.0:1788813446.995830:0:25305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813446.995833:0:25305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac600, rc 0) 00000100:00100000:1.0:1788813446.995918:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+7:18244:x1875706301803264:12345-192.168.202.13@tcp:101:mkdir.0 Request processed in 590us (2282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813446.995928:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 22 00010000:00010000:2.0:1788813447.076131:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813448.104238:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813448.554087:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813448.554109:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313434368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813448.554171:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813448.554219:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813448.554385:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313434496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813448.554410:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813448.554450:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313434368 00000100:00100000:1.0:1788813448.554457:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313434368 00000100:00100000:1.0:1788813448.554500:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313434496 00000100:00100000:1.0:1788813448.554502:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313434496 00000100:00100000:1.0:1788813448.554529:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813448.554536:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313434368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788813448.554568:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788813448.554606:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313434368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813448.554613:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813448.554628:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788813448.554633:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313434496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813448.554641:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788813448.554661:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313434496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813448.554667:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788813448.554680:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813448.554709:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313434496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813448.554733:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313434368:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788813449.130839:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813449.579127:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313434624:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.579457:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813449.579507:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313435136:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.579534:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813449.579553:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313435648:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.579574:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813449.579606:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313436160:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.579696:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813449.579737:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788813449.579747:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313435136 00000100:00100000:0.0:1788813449.579748:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313435008:0@lo:400:kworker.0 00000100:00100000:1.0:1788813449.579764:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313435136 00000100:00100000:0.0:1788813449.579785:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813449.579815:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313435520:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.579844:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813449.579851:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313435648 00000100:00100000:1.0:1788813449.579858:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313435648 00000100:00100000:0.0:1788813449.579875:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313436032:0@lo:400:kworker.0 00000100:00100000:1.0:1788813449.579884:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313436160 00000100:00100000:1.0:1788813449.579890:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313436160 00000100:00100000:0.0:1788813449.579907:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813449.579970:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313436032 00000100:00100000:1.0:1788813449.579976:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313436032 00000100:00100000:0.0:1788813449.579993:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313434752:0@lo:400:kworker.0 00000100:00100000:1.0:1788813449.580009:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788813449.580307:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813449.580329:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313435264:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.580349:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813449.580364:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313435776:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.580384:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813449.580393:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313436288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813449.580412:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813449.580432:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788813449.580438:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313434880:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.580458:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813449.580479:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313435392:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.580505:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813449.580520:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313435904:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.580541:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813449.580571:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313435776 00000100:00100000:0.0:1788813449.580579:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313435776 00000100:00100000:0.0:1788813449.580620:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313435904 00000100:00100000:0.0:1788813449.580623:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313435904 00000100:00100000:0.0:1788813449.580721:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813449.580730:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313435648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.580784:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313435648:12345-0@lo:400:kworker.0 Request processed in 55us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813449.580792:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813449.580809:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788813449.580816:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313436160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.580856:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313436160:12345-0@lo:400:kworker.0 Request processed in 40us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813449.580864:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788813449.580876:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788813449.580882:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313436032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.580908:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313436032:12345-0@lo:400:kworker.0 Request processed in 27us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813449.580913:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788813449.580923:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813449.580928:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313435776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.580990:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313435776:12345-0@lo:400:kworker.0 Request processed in 62us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813449.580996:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813449.581009:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788813449.581014:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313435904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.581039:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313435904:12345-0@lo:400:kworker.0 Request processed in 25us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813449.581044:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788813449.581065:0:24816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313435008 00000100:00100000:0.0:1788813449.581069:0:24816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313435008 00000100:00100000:1.0:1788813449.581157:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313435136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813449.581261:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313435136:12345-0@lo:400:kworker.0 Request processed in 1230us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813449.581285:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788813449.581295:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313434624 00000100:00100000:2.0:1788813449.581302:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313434624 00000100:00100000:2.0:1788813449.581341:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788813449.581350:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+24:3626:x1875706313434624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813449.581391:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+24:3626:x1875706313434624:12345-0@lo:400:kworker.0 Request processed in 43us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813449.581398:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788813449.581437:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313434752 00000100:00100000:2.0:1788813449.581442:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313434752 00000100:00100000:2.0:1788813449.581468:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313435264 00000100:00100000:2.0:1788813449.581472:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313435264 00000100:00100000:2.0:1788813449.581486:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788813449.581491:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313434752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813449.581536:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313434752:12345-0@lo:400:kworker.0 Request processed in 44us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813449.581543:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788813449.581556:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788813449.581562:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313435264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813449.581590:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313435264:12345-0@lo:400:kworker.0 Request processed in 29us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813449.581596:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788813449.581708:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813449.581715:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813449.581718:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813449.582013:0:24816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313435520 00000100:00100000:0.0:1788813449.582022:0:24816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313435520 00000100:00100000:2.0:1788813449.582810:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313434880 00000100:00100000:2.0:1788813449.582821:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313434880 00000100:00100000:2.0:1788813449.582872:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313435392 00000100:00100000:2.0:1788813449.582876:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313435392 00000100:00100000:2.0:1788813449.582895:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813449.582906:0:24230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313435008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813449.587687:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813449.587730:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313435520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813449.587869:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313435520:12345-0@lo:400:kworker.0 Request processed in 166us (8027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813449.587878:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813449.587911:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813449.587921:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313434880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813449.587978:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313434880:12345-0@lo:400:kworker.0 Request processed in 60us (7518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813449.587985:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813449.587999:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813449.588006:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a70f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313435392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813449.588054:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a70f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313435392:12345-0@lo:400:kworker.0 Request processed in 49us (7548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813449.588060:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788813449.588093:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813449.588401:0:24230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313435008:12345-0@lo:400:kworker.0 Request processed in 5498us (8618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813449.588409:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813449.588585:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313436544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813449.588624:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813449.588681:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813449.588688:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313436672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813449.588708:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813449.588742:0:23758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313436544 00000100:00100000:2.0:1788813449.588751:0:23758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313436544 00000100:00100000:2.0:1788813449.588785:0:23758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313436672 00000100:00100000:2.0:1788813449.588788:0:23758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313436672 00000100:00100000:2.0:1788813449.588800:0:23758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788813449.588827:0:23758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313436544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813449.588869:0:23758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788813449.588918:0:23758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313436544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813449.588924:0:23758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788813449.588978:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788813449.588988:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313436672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788813449.589012:0:22729:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788813449.589058:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313436672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813449.589074:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788813449.589264:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313436416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813449.589303:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813449.589381:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313436672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813449.589397:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313436544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813449.589494:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313436288 00000100:00100000:1.0:1788813449.589499:0:24233:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313436288 00000100:00100000:1.0:1788813449.589522:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313436416 00000100:00100000:1.0:1788813449.589525:0:24233:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313436416 00000100:00100000:1.0:1788813449.589537:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788813449.589543:0:24233:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313436288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813449.589565:0:24233:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788813449.589602:0:24233:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313436288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (9188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813449.589608:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788813449.589623:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788813449.589628:0:24233:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313436416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788813449.589636:0:24233:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788813449.589664:0:24233:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313436416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813449.589669:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788813449.589699:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313436416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813449.590400:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313434880:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.590418:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313435392:0@lo:400:kworker.0 00010000:00080000:0.0:1788813449.590436:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489436e6300 x1875706313435904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813449.590454:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313435904:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.590469:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313434752:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.590479:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313435264:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.590493:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313435776:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.590512:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313436288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813449.594507:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313435008:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.594532:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313435520:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.594548:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313436032:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.594561:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:151fd599-5695-4163-8caa-7faa559323aa:3626:1875706313434624:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.594575:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313435136:0@lo:400:kworker.0 00000100:00100000:0.0:1788813449.594588:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313435648:0@lo:400:kworker.0 00010000:00080000:0.0:1788813449.594605:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489436e6d80 x1875706313436160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813449.594617:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313436160:0@lo:400:kworker.0 00000001:00100000:3.0:1788813450.088257:0:24225:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f9ee3c2-14b6-4a7b-b263-f7a09903dc59 00000001:00100000:3.0:1788813450.088272:0:24225:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7492b028-cad1-4968-b6ea-0072cb2dae48 00000001:00100000:2.0:1788813450.088506:0:23456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2f9ee3c2-14b6-4a7b-b263-f7a09903dc59 00000001:00100000:2.0:1788813450.088514:0:23456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7492b028-cad1-4968-b6ea-0072cb2dae48 00000001:00100000:1.0:1788813450.089257:0:22703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2f9ee3c2-14b6-4a7b-b263-f7a09903dc59 00000001:00100000:1.0:1788813450.089265:0:22703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7492b028-cad1-4968-b6ea-0072cb2dae48 00010000:00010000:2.0:1788813450.151872:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813450.340651:0:23477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1788813450.386284:0:25604:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788813451.176271:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813452.170332:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813452.170429:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813452.170475:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813452.170512:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813452.170532:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813452.170601:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813452.170640:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301803904 00000100:00100000:1.0:1788813452.170651:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301803904 00000100:00100000:1.0:1788813452.170724:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301804416 00000100:00100000:1.0:1788813452.170727:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301804416 00000100:00100000:1.0:1788813452.170754:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:1.0:1788813452.170765:0:24228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2398:x1875706301803904:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813452.171508:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:2.0:1788813452.171531:0:24230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:2398:x1875706301804416:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813452.171600:0:24230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:2398:x1875706301804416:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 78us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813452.171608:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:3.0:1788813452.171807:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301803392 00000100:00100000:3.0:1788813452.171813:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301803392 00000100:00100000:3.0:1788813452.171863:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 149 00000100:00100000:3.0:1788813452.171871:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+13:2397:x1875706301803392:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813452.171915:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+13:2397:x1875706301803392:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 44us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813452.171922:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 149 00000100:00100000:3.0:1788813452.172007:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813452.172084:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813452.172140:0:24228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2398:x1875706301803904:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 1377us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813452.172147:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:1.0:1788813452.172159:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301803776 00000100:00100000:1.0:1788813452.172163:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301803776 00000100:00100000:1.0:1788813452.172201:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:1.0:1788813452.172209:0:24228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2398:x1875706301803776:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813452.172256:0:24228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2398:x1875706301803776:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 47us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813452.172262:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:0.0:1788813452.182314:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301803648 00000100:00100000:0.0:1788813452.182331:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301803648 00000100:00100000:0.0:1788813452.182392:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301804160 00000100:00100000:0.0:1788813452.182395:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301804160 00000100:00100000:0.0:1788813452.182408:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301803520 00000100:00100000:0.0:1788813452.182410:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301803520 00000100:00100000:3.0:1788813452.182412:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813452.182491:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301804032 00000100:00100000:0.0:1788813452.182495:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301804032 00000100:00100000:0.0:1788813452.182510:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 55 00000100:00100000:0.0:1788813452.182520:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2398:x1875706301803648:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813452.182660:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2398:x1875706301803648:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 141us (12230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813452.182668:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 55 00000100:00100000:0.0:1788813452.182688:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 56 00000100:00100000:0.0:1788813452.182695:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2398:x1875706301804160:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813452.182731:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2398:x1875706301804160:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (12208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813452.182738:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 56 00000100:00100000:0.0:1788813452.182750:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 57 00000100:00100000:0.0:1788813452.182756:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+6:2398:x1875706301803520:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813452.182780:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+6:2398:x1875706301803520:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (12179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813452.182786:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 57 00000100:00100000:0.0:1788813452.182798:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 58 00000100:00100000:0.0:1788813452.182804:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:2398:x1875706301804032:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813452.182827:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:2398:x1875706301804032:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 23us (10743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813452.182845:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 58 00000100:00100000:0.0:1788813452.184396:0:24816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301804288 00000100:00100000:0.0:1788813452.184410:0:24816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301804288 00000100:00100000:0.0:1788813452.184482:0:24816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00100000:0.0:1788813452.184491:0:24816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2398:x1875706301804288:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813452.184547:0:24816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2398:x1875706301804288:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 57us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813452.184554:0:24816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00080000:0.0:1788813452.184578:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813452.184583:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788813452.184586:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813452.184588:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788813452.196160:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788813453.163798:0:25045:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f9ee3c2-14b6-4a7b-b263-f7a09903dc59 00010000:00010000:2.0:1788813453.220390:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813453.669627:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788813453.669652:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313436800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813453.669727:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813453.669798:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313436800 00000100:00100000:2.0:1788813453.669807:0:24233:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313436800 00000100:00100000:2.0:1788813453.669892:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788813453.669900:0:24233:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313436800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788813453.669961:0:24233:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788813453.670012:0:24233:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313436800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813453.670018:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788813453.670188:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313436800:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788813453.673430:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813453.682797:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813453.682824:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313436928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813453.682905:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813453.683296:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313436928 00000100:00100000:1.0:1788813453.683304:0:24233:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313436928 00000100:00100000:1.0:1788813453.683363:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788813453.683372:0:24233:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313436928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813453.683397:0:24233:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788813453.683445:0:24233:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313436928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813453.683451:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788813453.683640:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813453.683676:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313436928:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788813453.960056:0:25752:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1adff150 20000000:00000080:3.0:1788813453.960077:0:25752:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff948a5e50f400 uarg=0000000000000000 20000000:01000000:3.0:1788813453.960119:0:25752:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788813453.960125:0:25752:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788813453.960130:0:25752:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788813453.963025:0:25753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788813453.963289:0:25752:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788813453.973741:0:25752:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788813453.973790:0:25752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a43dad600/0xf32533d6ff7049e5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.973812:0:25752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a44cda400/0xf32533d6ff704642 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70463b expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.973820:0:25752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a44cdac00/0xf32533d6ff704650 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704649 expref: 23 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.973828:0:25752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948941a80200/0xf32533d6ff70468f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704688 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.973835:0:25752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a43daca00/0xf32533d6ff704809 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704802 expref: 23 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.973845:0:25752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a43dac200/0xf32533d6ff704975 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729cb6 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.973853:0:25752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a43dade00/0xf32533d6ff7049b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d26 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.973861:0:25752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948a43dad600/0xf32533d6ff7049e5 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.973907:0:25752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a43dade00/0xf32533d6ff7049b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d26 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.974328:0:25752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a43dade00/0xf32533d6ff7049b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d26 expref: 12 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.974346:0:25752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875706313437056:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813453.974480:0:25752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a43dac200/0xf32533d6ff704975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729cb6 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.974490:0:25752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a43dac200/0xf32533d6ff704975 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729cb6 expref: 12 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.974499:0:25752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875706313437184:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813453.974538:0:25752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a43daca00/0xf32533d6ff704809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff704802 expref: 23 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.974547:0:25752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a43daca00/0xf32533d6ff704809 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff704802 expref: 23 pid: 22716 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.974557:0:25752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875706313437312:0@lo:104: 00000100:00100000:1.0:1788813453.974598:0:25752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813453.974630:0:25752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948941a80200/0xf32533d6ff70468f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff704688 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.974638:0:25752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948941a80200/0xf32533d6ff70468f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff704688 expref: 23 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.974646:0:25752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875706313437440:0@lo:104: 00000100:00100000:1.0:1788813453.974666:0:25752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813453.974700:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313437312 00000100:00100000:1.0:1788813453.974709:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313437312 00000100:00100000:1.0:1788813453.974749:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313437440 00000100:00100000:1.0:1788813453.974752:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313437440 00000100:00100000:1.0:1788813453.974768:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813453.974777:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+4:25752:x1875706313437312:12345-0@lo:104: 00010000:00010000:1.0:1788813453.974800:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a44cdba00/0xf32533d6ff704802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff704809 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.974852:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813453.974857:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+4:25752:x1875706313437312:12345-0@lo:104: Request processed in 82us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813453.974865:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813453.974888:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813453.974897:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+3:25752:x1875706313437440:12345-0@lo:104: 00010000:00010000:1.0:1788813453.974905:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948941a81000/0xf32533d6ff704688 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70468f expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.974989:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813453.974994:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+3:25752:x1875706313437440:12345-0@lo:104: Request processed in 100us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813453.975000:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788813453.975034:0:25752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a44cdac00/0xf32533d6ff704650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff704649 expref: 23 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.975043:0:25752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a44cdac00/0xf32533d6ff704650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff704649 expref: 23 pid: 22716 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.975051:0:25752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875706313437568:0@lo:104: 00000100:00100000:1.0:1788813453.975072:0:25752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813453.975090:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313437568 00000100:00100000:1.0:1788813453.975093:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313437568 00000100:00100000:1.0:1788813453.975110:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813453.975116:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+3:25752:x1875706313437568:12345-0@lo:104: 00010000:00010000:1.0:1788813453.975132:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff704649 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff704650 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.975154:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813453.975858:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813453.975867:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:151fd599-5695-4163-8caa-7faa559323aa+3:25752:x1875706313437568:12345-0@lo:104: Request processed in 751us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813453.975875:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788813453.976112:0:25752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a44cda400/0xf32533d6ff704642 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff70463b expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.976124:0:25752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a44cda400/0xf32533d6ff704642 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff70463b expref: 23 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.976136:0:25752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875706313437696:0@lo:104: 00000100:00100000:1.0:1788813453.976299:0:25752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813453.976329:0:25752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489434b1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813453.976352:0:25752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875706313437312:0@lo:104: 00000100:00100000:1.0:1788813453.976485:0:25752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875706313437440:0@lo:104: 00000100:00100000:1.0:1788813453.976494:0:25752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875706313437568:0@lo:104: 00000100:00100000:0.0:1788813453.976698:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313437696 00000100:00100000:0.0:1788813453.976705:0:22707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313437696 00000100:00100000:0.0:1788813453.976754:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813453.976763:0:22707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:151fd599-5695-4163-8caa-7faa559323aa+3:25752:x1875706313437696:12345-0@lo:104: 00010000:00010000:0.0:1788813453.976775:0:22707:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948941a81800/0xf32533d6ff70463b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff704642 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.976859:0:25752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875706313437696:0@lo:104: 00010000:00010000:3.0:1788813453.977237:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a44cdba00/0xf32533d6ff704802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff704809 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977247:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdba00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813453.977252:0:23478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a44cdba00/0xf32533d6ff704802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff704809 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977277:0:23478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a44cdba00/0xf32533d6ff704802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff704809 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813453.977284:0:23478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a44cdba00/0xf32533d6ff704802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff704809 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813453.977290:0:23478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788813453.977332:0:23478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a44cdba00/0xf32533d6ff704802 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff704809 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977338:0:23478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813453.977362:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a44cdba00/0xf32533d6ff704802 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff704809 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977370:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a44cdba00/0xf32533d6ff704802 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff704809 expref: -99 pid: 25044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977385:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788813453.977390:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948941a81000/0xf32533d6ff704688 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70468f expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977395:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a81000 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813453.977398:0:23478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948941a81000/0xf32533d6ff704688 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff70468f expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977404:0:23478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948941a81000/0xf32533d6ff704688 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff70468f expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813453.977409:0:23478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948941a81000/0xf32533d6ff704688 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff70468f expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813453.977419:0:23478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788813453.977445:0:23478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948941a81000/0xf32533d6ff704688 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70468f expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977450:0:23478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813453.977459:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948941a81000/0xf32533d6ff704688 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70468f expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977465:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948941a81000/0xf32533d6ff704688 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70468f expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977478:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813453.977481:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff704649 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff704650 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977487:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdbe00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813453.977490:0:23478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff704649 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff704650 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977495:0:23478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff704649 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff704650 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813453.977500:0:23478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff704649 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff704650 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813453.977505:0:23478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788813453.977530:0:23478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff704649 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff704650 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977536:0:23478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813453.977561:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff704649 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff704650 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977568:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff704649 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff704650 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977578:0:23478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813453.977581:0:23478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948941a81800/0xf32533d6ff70463b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff704642 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977586:0:23478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a81800 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813453.977589:0:23478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948941a81800/0xf32533d6ff70463b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff704642 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977595:0:23478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948941a81800/0xf32533d6ff70463b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff704642 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813453.977600:0:23478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948941a81800/0xf32533d6ff70463b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff704642 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813453.977605:0:23478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788813453.977629:0:23478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948941a81800/0xf32533d6ff70463b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff704642 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977634:0:23478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813453.977641:0:23478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948941a81800/0xf32533d6ff70463b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff704642 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.977647:0:23478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948941a81800/0xf32533d6ff70463b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff704642 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.977743:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813453.977753:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813453.977769:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:151fd599-5695-4163-8caa-7faa559323aa:3625:1875706313437824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813453.977819:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813453.977868:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813453.977875:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:151fd599-5695-4163-8caa-7faa559323aa:3625:1875706313437952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813453.977896:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813453.977970:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:151fd599-5695-4163-8caa-7faa559323aa:3628:1875706313438208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813453.977992:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813453.978015:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788813453.978019:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:151fd599-5695-4163-8caa-7faa559323aa:3628:1875706313438080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813453.978038:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813453.978059:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313437824 00000100:00100000:2.0:1788813453.978064:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313437824 00010000:00010000:2.0:1788813453.978089:0:22710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a43daca00/0xf32533d6ff704809 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff704802 expref: 24 pid: 22716 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813453.978106:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313437952 00000100:00100000:2.0:1788813453.978109:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313437952 00010000:00010000:2.0:1788813453.978119:0:22710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948941a80200/0xf32533d6ff70468f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff704688 expref: 25 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813453.978137:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313438208 00000100:00100000:2.0:1788813453.978140:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313438208 00010000:00010000:2.0:1788813453.978151:0:22710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a44cda400/0xf32533d6ff704642 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70463b expref: 26 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.978479:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313438080 00000100:00100000:1.0:1788813453.978485:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313438080 00010000:00010000:1.0:1788813453.978509:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a44cdac00/0xf32533d6ff704650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff704649 expref: 27 pid: 22716 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.978542:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813453.978551:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:151fd599-5695-4163-8caa-7faa559323aa+27:3625:x1875706313437824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813453.978565:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813453.978582:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a43daca00/0xf32533d6ff704809 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff704802 expref: 27 pid: 22716 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.978593:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813453.978597:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813453.978597:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a43daca00/0xf32533d6ff704809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff704802 expref: 27 pid: 22716 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.978602:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813453.978616:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a43daca00/0xf32533d6ff704809 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff704802 expref: 27 pid: 22716 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.978630:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813453.978648:0:22710:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788813453.978667:0:22710:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788813453.978685:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:151fd599-5695-4163-8caa-7faa559323aa+26:3625:x1875706313437824:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813453.978687:0:22709:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788813453.978698:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813453.978747:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:151fd599-5695-4163-8caa-7faa559323aa:3625:1875706313437824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813453.978857:0:22707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788813453.978865:0:22707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:151fd599-5695-4163-8caa-7faa559323aa+3:25752:x1875706313437696:12345-0@lo:104: Request processed in 2103us (2565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813453.978873:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788813453.978924:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813453.984237:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813453.984257:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:151fd599-5695-4163-8caa-7faa559323aa+25:3625:x1875706313437952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813453.984277:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813453.984286:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff948941a80200/0xf32533d6ff70468f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff704688 expref: 25 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.984300:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948941a80200/0xf32533d6ff70468f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff704688 expref: 25 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.984319:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948941a80200/0xf32533d6ff70468f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff704688 expref: 25 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.984334:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813453.984410:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:151fd599-5695-4163-8caa-7faa559323aa+24:3625:x1875706313437952:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (6511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813453.984418:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813453.984466:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:151fd599-5695-4163-8caa-7faa559323aa:3625:1875706313437952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813453.984495:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813453.984501:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:151fd599-5695-4163-8caa-7faa559323aa+23:3628:x1875706313438208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813453.984524:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813453.984528:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff948a44cda400/0xf32533d6ff704642 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70463b expref: 23 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.984537:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a44cda400/0xf32533d6ff704642 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff70463b expref: 23 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.984546:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cda400/0xf32533d6ff704642 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff70463b expref: 23 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.984555:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813453.984584:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:151fd599-5695-4163-8caa-7faa559323aa+22:3628:x1875706313438208:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (6591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813453.984591:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813453.984616:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:151fd599-5695-4163-8caa-7faa559323aa:3628:1875706313438208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813453.984635:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813453.984642:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:151fd599-5695-4163-8caa-7faa559323aa+21:3628:x1875706313438080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813453.984663:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813453.984669:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff948a44cdac00/0xf32533d6ff704650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff704649 expref: 21 pid: 22716 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.984677:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a44cdac00/0xf32533d6ff704650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff704649 expref: 21 pid: 22716 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.984687:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cdac00/0xf32533d6ff704650 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff704649 expref: 21 pid: 22716 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.984695:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813453.984729:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:151fd599-5695-4163-8caa-7faa559323aa+20:3628:x1875706313438080:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (6689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813453.984736:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813453.984759:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:151fd599-5695-4163-8caa-7faa559323aa:3628:1875706313438080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813453.992573:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813453.992831:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301804544 00000100:00100000:0.0:1788813453.992842:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301804544 00010000:00010000:0.0:1788813453.992887:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a43dade00/0xf32533d6ff7049b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d26 expref: 13 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813453.992952:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:0.0:1788813453.992980:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a74bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30ad7580-cbca-4182-959d-28f6755d6280+13:2396:x1875706301804544:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813453.992996:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813453.993002:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff948a43dade00/0xf32533d6ff7049b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d26 expref: 13 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.993017:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a43dade00/0xf32533d6ff7049b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d26 expref: 13 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.993037:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813453.993088:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a74bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30ad7580-cbca-4182-959d-28f6755d6280+13:2396:x1875706301804544:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 109us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813453.993096:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:3.0:1788813453.993365:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00010000:00010000:1.0:1788813453.995129:0:25752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a43dade00/0xf32533d6ff7049b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d26 expref: 12 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.995155:0:25752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875706313437056:192.168.202.13@tcp:104: 00000100:00100000:1.0:1788813453.996265:0:25752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875706313437184:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813453.996312:0:25752:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948a43dad600/0xf32533d6ff7049e5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813453.999968:0:25754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301804672 00000100:00100000:0.0:1788813453.999990:0:25754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301804672 00010000:00010000:0.0:1788813454.000042:0:25754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a43dac200/0xf32533d6ff704975 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729cb6 expref: 12 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813454.000083:0:25754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00100000:0.0:1788813454.000093:0:25754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30ad7580-cbca-4182-959d-28f6755d6280+12:2396:x1875706301804672:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813454.000109:0:25754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813454.000115:0:25754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff948a43dac200/0xf32533d6ff704975 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729cb6 expref: 12 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.000129:0:25754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a43dac200/0xf32533d6ff704975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729cb6 expref: 12 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.000147:0:25754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a43dac200/0xf32533d6ff704975 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729cb6 expref: 12 pid: 22717 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.000183:0:25754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948a43dad600/0xf32533d6ff7049e5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.000192:0:25754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a43dad600/0xf32533d6ff7049e5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.000222:0:25754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a43dad600/0xf32533d6ff7049e5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.000230:0:25754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a43dad600/0xf32533d6ff7049e5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.000237:0:25754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a43dad600/0xf32533d6ff7049e5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.000244:0:25754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a43dad600/0xf32533d6ff7049e5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.000251:0:25754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813454.000256:0:25754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a43dad600/0xf32533d6ff7049e5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.000264:0:25754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a43dad600/0xf32533d6ff7049e5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.000291:0:25754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a43dad600/0xf32533d6ff7049e5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.000302:0:25754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813454.000367:0:25754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30ad7580-cbca-4182-959d-28f6755d6280+11:2396:x1875706301804672:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 274us (7001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813454.000382:0:25754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 14 00010000:00010000:1.0:1788813454.000969:0:25752:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948a43dad600/0xf32533d6ff7049e5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813454.000981:0:25752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a43dad600/0xf32533d6ff7049e5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813454.000988:0:25752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a43dad600/0xf32533d6ff7049e5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813454.244450:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788813454.564863:0:22759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788813454.692233:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313438336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813454.692337:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813454.692452:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313438336 00000100:00100000:2.0:1788813454.692462:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313438336 00000100:00100000:2.0:1788813454.692519:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788813454.692530:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313438336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813454.692565:0:22729:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788813454.692633:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313438336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813454.692642:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788813454.692659:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313438464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813454.692718:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813454.692765:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313438336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813454.692957:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813454.692968:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313438592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813454.693004:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813454.693041:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313438592 00000100:00100000:0.0:1788813454.693047:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313438592 00000100:00100000:3.0:1788813454.693062:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:151fd599-5695-4163-8caa-7faa559323aa:3628:1875706313438720:0@lo:400:kworker.0 00000100:00100000:0.0:1788813454.693083:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788813454.693092:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313438592:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813454.693099:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1788813454.693116:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788813454.693162:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313438848:0@lo:400:kworker.0 00000100:00100000:0.0:1788813454.693168:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313438592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813454.693176:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788813454.693213:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813454.693243:0:24816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313438848 00000100:00100000:0.0:1788813454.693248:0:24816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313438848 00000100:00100000:3.0:1788813454.693264:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313438592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813454.693280:0:24816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788813454.693289:0:24816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313438848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813454.693320:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813454.693328:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313438976:0@lo:400:kworker.0 00000100:00100000:0.0:1788813454.693332:0:24816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313438848:12345-0@lo:400:kworker.0 Request processed in 43us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813454.693340:0:24816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813454.693359:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813454.693386:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313438848:0@lo:400:kworker.0 00000100:00100000:3.0:1788813454.693431:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813454.693440:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313439104:0@lo:400:kworker.0 00000100:00100000:1.0:1788813454.693462:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313438976 00000100:00100000:1.0:1788813454.693467:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313438976 00000100:00100000:3.0:1788813454.693477:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813454.693501:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313439232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813454.693512:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788813454.693523:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313438976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813454.693539:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813454.693574:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313438976:12345-0@lo:400:kworker.0 Request processed in 55us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813454.693584:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788813454.693607:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813454.693610:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813454.693619:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313439616:0@lo:400:kworker.0 00000100:00100000:1.0:1788813454.693626:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313438464 00000100:00100000:1.0:1788813454.693631:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313438464 00000100:00100000:3.0:1788813454.693648:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813454.693659:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313439232 00000100:00100000:1.0:1788813454.693664:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313439232 00000100:00100000:1.0:1788813454.693682:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788813454.693704:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313438464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788813454.693722:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788813454.693752:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313438464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813454.693757:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788813454.693770:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788813454.693775:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313439232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813454.693783:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788813454.693804:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313439232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813454.693809:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788813454.693824:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813454.693842:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313439488:0@lo:400:kworker.0 00000100:00100000:1.0:1788813454.693872:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813454.693903:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313438464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813454.693916:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813454.693922:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313439360:0@lo:400:kworker.0 00000100:00100000:1.0:1788813454.693971:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813454.693996:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313439104 00000100:00100000:1.0:1788813454.693999:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313439104 00000100:00100000:1.0:1788813454.694023:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313439616 00000100:00100000:1.0:1788813454.694025:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313439616 00000100:00100000:1.0:1788813454.694039:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313439488 00000100:00100000:1.0:1788813454.694042:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313439488 00000100:00100000:1.0:1788813454.694053:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788813454.694059:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313439104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813454.694085:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313439104:12345-0@lo:400:kworker.0 Request processed in 27us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813454.694091:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788813454.694101:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788813454.694107:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313439616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813454.694129:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313439616:12345-0@lo:400:kworker.0 Request processed in 23us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813454.694134:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788813454.694144:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788813454.694148:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313439488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813454.694172:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313439488:12345-0@lo:400:kworker.0 Request processed in 24us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813454.694177:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1788813454.694199:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813454.694229:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313439488:0@lo:400:kworker.0 00000100:00100000:1.0:1788813454.694249:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313438976:0@lo:400:kworker.0 00000100:00100000:1.0:1788813454.694275:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313439744:0@lo:400:kworker.0 00000100:00100000:1.0:1788813454.694295:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813454.694315:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313439616:0@lo:400:kworker.0 00000100:00100000:1.0:1788813454.694326:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313439232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813454.694333:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313439104:0@lo:400:kworker.0 00000100:00100000:1.0:1788813454.694350:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313439744 00000100:00100000:1.0:1788813454.694352:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313439744 00000100:00100000:1.0:1788813454.694372:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788813454.694377:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313439744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813454.694404:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313439744:12345-0@lo:400:kworker.0 Request processed in 27us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813454.694409:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788813454.694424:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788813454.694441:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948944024000 x1875706313439744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813454.694451:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313439744:0@lo:400:kworker.0 00000100:00100000:3.0:1788813454.694776:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813454.694785:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313439872:0@lo:400:kworker.0 00000100:00100000:3.0:1788813454.694818:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813454.694842:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313439872 00000100:00100000:3.0:1788813454.694846:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313439872 00000100:00100000:3.0:1788813454.694875:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788813454.694881:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313439872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813454.694914:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313439872:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813454.694920:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788813454.695095:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813454.695551:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313438720 00000100:00100000:2.0:1788813454.695568:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313438720 00000100:00100000:0.0:1788813454.695778:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313439360 00000100:00100000:0.0:1788813454.695782:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313439360 00000100:00100000:0.0:1788813454.695813:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788813454.695821:0:24230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313439360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813454.695871:0:24230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313439360:12345-0@lo:400:kworker.0 Request processed in 51us (1899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813454.695892:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788813454.701618:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788813454.701648:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+20:3628:x1875706313438720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813454.701772:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+20:3628:x1875706313438720:12345-0@lo:400:kworker.0 Request processed in 140us (8673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813454.701780:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788813454.702058:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813454.702078:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313440000:0@lo:400:kworker.0 00000100:00100000:0.0:1788813454.702120:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813454.702194:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:151fd599-5695-4163-8caa-7faa559323aa:3628:1875706313438720:0@lo:400:kworker.0 00000100:00100000:2.0:1788813454.702330:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313440000 00000100:00100000:2.0:1788813454.702338:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313440000 00000100:00100000:2.0:1788813454.702393:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788813454.702400:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313440000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813454.702436:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313440000:12345-0@lo:400:kworker.0 Request processed in 37us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813454.702459:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788813454.702522:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788813454.702546:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccfad80 x1875706313440000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813454.702567:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313440000:0@lo:400:kworker.0 00000100:00100000:3.0:1788813454.703404:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313439872:0@lo:400:kworker.0 00000100:00100000:3.0:1788813454.703421:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313439360:0@lo:400:kworker.0 10000000:01000000:1.0:1788813455.077642:0:22720:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813455.077651:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a7d688800 from 13 10000000:01000000:1.0:1788813455.077657:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813455.077710:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dad600/0xf32533d6ff7049ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813455.077741:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a43dad600/0xf32533d6ff7049ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813455.077753:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a43dad600/0xf32533d6ff7049ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813455.077779:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313440128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813455.077860:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813455.077906:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a51688180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813455.080578:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313440128 00000100:00100000:2.0:1788813455.080594:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313440128 00000100:00100000:2.0:1788813455.080678:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788813455.080689:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+20:22720:x1875706313440128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813455.080707:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813455.080727:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948941a80200/0xf32533d6ff7049f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7049ec expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.080755:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948941a80200/0xf32533d6ff7049f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7049ec expref: 21 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.080767:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948941a80200/0xf32533d6ff7049f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7049ec expref: 21 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.080775:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948941a80200, rc 0) 00000100:00100000:2.0:1788813455.080875:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+21:22720:x1875706313440128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (3014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813455.080882:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788813455.081648:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313440128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813455.081684:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a43dad600/0xf32533d6ff7049ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7049f3 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813455.081696:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a43dad600/0xf32533d6ff7049ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7049f3 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813455.081779:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313440256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813455.081822:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813455.081857:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a51688180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813455.084835:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313440256 00000100:00100000:3.0:1788813455.084856:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313440256 00000100:00100000:3.0:1788813455.084972:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788813455.084985:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a484cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+21:22720:x1875706313440256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813455.085191:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a484cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+21:22720:x1875706313440256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (3368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813455.085208:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788813455.087724:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313440256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813455.087797:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313440384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813455.087878:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813455.087980:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813455.088139:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313440384 00000100:00100000:3.0:1788813455.088146:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313440384 00000100:00100000:3.0:1788813455.088210:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788813455.088229:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a4a623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+21:22720:x1875706313440384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813455.088359:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a4a623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+21:22720:x1875706313440384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813455.088367:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788813455.088703:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313440384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788813455.089914:0:25766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788813455.092222:0:22720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788813455.092264:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813455.092275:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dad600/0xf32533d6ff7049ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7049f3 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813455.092290:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a43dad600/0xf32533d6ff7049ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7049f3 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813455.092326:0:22720:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813455.092329:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a6eae1000 from 13 10000000:01000000:1.0:1788813455.092332:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813455.092369:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff7049fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813455.092378:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff7049fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813455.092388:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff7049fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813455.092412:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313440512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813455.092483:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813455.092781:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313440512 00000100:00100000:0.0:1788813455.092790:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313440512 00000100:00100000:0.0:1788813455.092890:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788813455.092900:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a4a623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+21:22720:x1875706313440512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813455.092913:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813455.092926:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cdba00/0xf32533d6ff704a01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7049fa expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.092978:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdba00/0xf32533d6ff704a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7049fa expref: 22 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.092988:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cdba00/0xf32533d6ff704a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7049fa expref: 22 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.092996:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdba00, rc 0) 00000100:00100000:0.0:1788813455.093038:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a4a623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+22:22720:x1875706313440512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813455.093058:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788813455.093128:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a51688180 going to sleep for 11 seconds 00000100:00100000:1.0:1788813455.093150:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313440512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813455.093164:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff7049fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704a01 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813455.093173:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff7049fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff704a01 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813455.093239:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313440640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813455.093263:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813455.096816:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a51688180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813455.100237:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313440640 00000100:00100000:3.0:1788813455.100255:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313440640 00000100:00100000:3.0:1788813455.100321:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788813455.100331:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a4a620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+22:22720:x1875706313440640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813455.100500:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a4a620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+22:22720:x1875706313440640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (7234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813455.100507:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788813455.100834:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313440640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813455.100888:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313440768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813455.100978:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813455.101001:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a51688180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813455.102699:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313440768 00000100:00100000:3.0:1788813455.102710:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313440768 00000100:00100000:3.0:1788813455.102745:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788813455.102754:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+22:22720:x1875706313440768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813455.102893:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+22:22720:x1875706313440768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813455.102901:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788813455.103131:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948941ba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313440768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788813455.104976:0:25767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788813455.106177:0:22720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788813455.106218:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813455.106230:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff7049fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704a01 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.106243:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff7049fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704a01 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813455.106254:0:22720:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788813455.106257:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a6eab6800 from 13 10000000:01000000:0.0:1788813455.106260:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813455.106299:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda200/0xf32533d6ff704a08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.106307:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cda200/0xf32533d6ff704a08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.106319:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cda200/0xf32533d6ff704a08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813455.106345:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313440896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813455.106406:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813455.106451:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2840 going to sleep for 11 seconds 00000100:00100000:3.0:1788813455.107214:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313440896 00000100:00100000:3.0:1788813455.107224:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313440896 00000100:00100000:3.0:1788813455.107287:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788813455.107296:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+22:22720:x1875706313440896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813455.107310:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813455.107327:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc09400/0xf32533d6ff704a0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff704a08 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.107350:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc09400/0xf32533d6ff704a0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff704a08 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.107377:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc09400/0xf32533d6ff704a0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704a08 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.107386:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09400, rc 0) 00000100:00100000:3.0:1788813455.107438:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+23:22720:x1875706313440896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813455.107444:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788813455.108376:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313440896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813455.108398:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cda200/0xf32533d6ff704a08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704a0f expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.108408:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cda200/0xf32533d6ff704a08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff704a0f expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813455.108498:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313441024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813455.109490:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813455.109813:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313441024 00000100:00100000:3.0:1788813455.109822:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313441024 00000100:00100000:3.0:1788813455.109862:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788813455.109871:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+23:22720:x1875706313441024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813455.110025:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+23:22720:x1875706313441024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813455.110033:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788813455.118783:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813455.118830:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313441024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813455.118891:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313441152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813455.119181:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813455.119280:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2840 going to sleep for 11 seconds 00000100:00100000:3.0:1788813455.126187:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313441152 00000100:00100000:3.0:1788813455.126217:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313441152 00000100:00100000:3.0:1788813455.126395:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788813455.126407:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a82055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+23:22720:x1875706313441152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813455.126585:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a82055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+23:22720:x1875706313441152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (7403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813455.126603:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788813455.126712:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313441152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788813455.127741:0:25768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788813455.127823:0:22720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788813455.127846:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813455.127856:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda200/0xf32533d6ff704a08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704a0f expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.127868:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cda200/0xf32533d6ff704a08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704a0f expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813455.127879:0:22720:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788813455.127882:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9489430d0800 from 13 10000000:01000000:0.0:1788813455.127886:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813455.127920:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdbc00/0xf32533d6ff704a16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.127929:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cdbc00/0xf32533d6ff704a16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.127984:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cdbc00/0xf32533d6ff704a16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813455.128007:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313441280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813455.128060:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813455.135920:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813455.139318:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313441280 00000100:00100000:2.0:1788813455.139356:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313441280 00000100:00100000:2.0:1788813455.139425:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788813455.139436:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+23:22720:x1875706313441280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813455.139452:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813455.139476:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948941a81600/0xf32533d6ff704a1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff704a16 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.139505:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948941a81600/0xf32533d6ff704a1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff704a16 expref: 24 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.139515:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948941a81600/0xf32533d6ff704a1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff704a16 expref: 24 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.139523:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948941a81600, rc 0) 00000100:00100000:2.0:1788813455.140401:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+24:22720:x1875706313441280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 964us (12336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813455.140411:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788813455.142151:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313441280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813455.142179:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cdbc00/0xf32533d6ff704a16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704a1d expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.142191:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cdbc00/0xf32533d6ff704a16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff704a1d expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813455.142287:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313441408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813455.142342:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813455.142381:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813455.142456:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313441408 00000100:00100000:2.0:1788813455.142464:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313441408 00000100:00100000:2.0:1788813455.142509:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788813455.142518:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+24:22720:x1875706313441408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813455.142673:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:151fd599-5695-4163-8caa-7faa559323aa+24:22720:x1875706313441408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813455.142680:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788813455.142821:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313441408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813455.142852:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313441536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813455.142901:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813455.142924:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2840 going to sleep for 11 seconds 00000100:00100000:1.0:1788813455.143045:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313441536 00000100:00100000:1.0:1788813455.143051:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313441536 00000100:00100000:1.0:1788813455.147523:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788813455.147552:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+24:22720:x1875706313441536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813455.147761:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:151fd599-5695-4163-8caa-7faa559323aa+24:22720:x1875706313441536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (4858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813455.147769:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788813455.148094:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:151fd599-5695-4163-8caa-7faa559323aa:22720:1875706313441536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788813455.149334:0:25769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788813455.149506:0:22720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788813455.149536:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813455.149548:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdbc00/0xf32533d6ff704a16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704a1d expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.149578:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cdbc00/0xf32533d6ff704a16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff704a1d expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813455.169210:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813455.170491:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301804800 00000100:00100000:2.0:1788813455.170505:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301804800 00000100:00100000:2.0:1788813455.170599:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 163 00000100:00100000:2.0:1788813455.170610:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+11:18091:x1875706301804800:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813455.170635:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813455.170656:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948941a81800/0xf32533d6ff704a24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729d5e expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.170974:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948941a81800/0xf32533d6ff704a24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d5e expref: 12 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.170988:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948941a81800/0xf32533d6ff704a24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d5e expref: 12 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.170998:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948941a81800, rc 0) 00000100:00100000:2.0:1788813455.171191:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+12:18091:x1875706301804800:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 Request processed in 582us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813455.171207:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 163 00000100:00100000:0.0:1788813455.183798:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813455.183889:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301804928 00000100:00100000:3.0:1788813455.183901:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301804928 00000100:00100000:3.0:1788813455.184006:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 164 00000100:00100000:3.0:1788813455.184019:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+12:18091:x1875706301804928:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813455.184211:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+12:18091:x1875706301804928:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 Request processed in 184us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813455.184220:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 164 00000100:00100000:0.0:1788813455.197756:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813455.197849:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301805056 00000100:00100000:2.0:1788813455.197859:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301805056 00000100:00100000:2.0:1788813455.197917:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 165 00000100:00100000:2.0:1788813455.197928:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+12:18091:x1875706301805056:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813455.198134:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+12:18091:x1875706301805056:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 Request processed in 196us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813455.198144:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 165 00000100:00100000:0.0:1788813455.237389:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813455.237556:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301805184 00000100:00100000:1.0:1788813455.237569:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301805184 00000100:00100000:1.0:1788813455.237816:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 166 00000100:00100000:1.0:1788813455.237828:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+12:18091:x1875706301805184:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813455.237846:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813455.237865:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a43dad200/0xf32533d6ff704a2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729d65 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813455.237896:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a43dad200/0xf32533d6ff704a2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d65 expref: 13 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813455.237908:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a43dad200/0xf32533d6ff704a2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d65 expref: 13 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813455.237917:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dad200, rc 0) 00000100:00100000:1.0:1788813455.238021:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+13:18091:x1875706301805184:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 Request processed in 195us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813455.238043:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 166 00000100:00100000:0.0:1788813455.251775:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813455.251961:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301805312 00000100:00100000:3.0:1788813455.251972:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301805312 00000100:00100000:3.0:1788813455.252027:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 167 00000100:00100000:3.0:1788813455.252037:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+13:18091:x1875706301805312:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813455.252185:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30ad7580-cbca-4182-959d-28f6755d6280+13:18091:x1875706301805312:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 Request processed in 149us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813455.252193:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 167 00000100:00100000:0.0:1788813455.262738:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813455.262800:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301805440 00000100:00100000:1.0:1788813455.262812:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301805440 00000100:00100000:1.0:1788813455.262880:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 168 00000100:00100000:1.0:1788813455.262894:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+13:18091:x1875706301805440:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813455.263103:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30ad7580-cbca-4182-959d-28f6755d6280+13:18091:x1875706301805440:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 Request processed in 212us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813455.263111:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 168 00010000:00010000:3.0:1788813455.269615:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813455.826726:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813455.826908:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301805568 00000100:00100000:3.0:1788813455.826925:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301805568 00000100:00100000:3.0:1788813455.827103:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:3.0:1788813455.827116:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+6:18713:x1875706301805568:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813455.827145:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788813455.827880:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788813455.829260:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729d6c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829373:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829403:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829419:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829457:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829464:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829471:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829565:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09e00/0xf32533d6ff704a47 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829575:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09e00/0xf32533d6ff704a47 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829581:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09e00/0xf32533d6ff704a47 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813455.829629:0:22724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788813455.829633:0:22724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813455.829685:0:22724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09e00/0xf32533d6ff704a47 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829696:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829703:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829711:0:22724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829729:0:22724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813455.829734:0:22724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829742:0:22724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829755:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6e8e4900) 00010000:00010000:3.0:1788813455.829759:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813455.829764:0:22724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829770:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829788:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829793:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829798:0:22724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829803:0:22724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813455.829805:0:22724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829810:0:22724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829828:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff948a6fe50c00) 00010000:00010000:3.0:1788813455.829831:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813455.829834:0:22724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829839:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829880:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d6c expref: 8 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829894:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09e00/0xf32533d6ff704a47 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d6c expref: 7 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.829902:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff948a6fe50a00) 00010000:00010000:3.0:1788813455.829904:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813455.829906:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09e00, rc 0) 00000100:00100000:3.0:1788813455.830053:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+7:18713:x1875706301805568:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 2939us (3340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813455.830062:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:0.0:1788813455.834041:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813455.834360:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301805696 00000100:00100000:1.0:1788813455.834377:0:22735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301805696 00000100:00100000:1.0:1788813455.834476:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:1.0:1788813455.834490:0:22735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7492b028-cad1-4968-b6ea-0072cb2dae48+7:18713:x1875706301805696:12345-192.168.202.13@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788813455.834625:0:22735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7492b028-cad1-4968-b6ea-0072cb2dae48+7:18713:x1875706301805696:12345-192.168.202.13@tcp:900:lhsmtool_posix.0 Request processed in 139us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813455.834634:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:1.0:1788813455.844437:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813455.846481:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301805952 00000100:00100000:2.0:1788813455.846505:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301805952 00000100:00100000:2.0:1788813455.846609:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:2.0:1788813455.846623:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948941ba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+7:18713:x1875706301805952:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813455.846672:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813455.846703:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704a4e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729d73 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.846815:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a55 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.846835:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a55 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.846850:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a55 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.846867:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704a5c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.846874:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704a5c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.846880:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704a5c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847093:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80a00/0xf32533d6ff704a63 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847101:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80a00/0xf32533d6ff704a63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847110:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80a00/0xf32533d6ff704a63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813455.847121:0:22725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788813455.847390:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a55 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847400:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a55 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847408:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a55 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847415:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a80e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813455.847420:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a55 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847430:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a55 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847445:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff948a6fe50a00) 00010000:00010000:2.0:1788813455.847448:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813455.847455:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a55 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847463:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a55 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847479:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704a5c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847485:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704a5c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847492:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704a5c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847507:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a81e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813455.847511:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704a5c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847517:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704a5c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847525:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff948942ffbc00) 00010000:00010000:2.0:1788813455.847528:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813455.847531:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704a5c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.847537:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704a5c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.851461:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704a4e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d73 expref: 10 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.851497:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80a00/0xf32533d6ff704a63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d73 expref: 9 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.851508:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948942ffb900) 00010000:00010000:2.0:1788813455.851512:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813455.851515:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948941a80a00, rc 0) 00000100:00100000:2.0:1788813455.851690:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948941ba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+9:18713:x1875706301805952:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 5067us (7272us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788813455.851702:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:3.0:1788813455.888422:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813455.888672:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301806080 00000100:00100000:2.0:1788813455.888705:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301806080 00000100:00100000:2.0:1788813455.888780:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:2.0:1788813455.888794:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+9:18713:x1875706301806080:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788813455.889005:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+9:18713:x1875706301806080:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 Request processed in 213us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813455.889013:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:0.0:1788813455.891846:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813455.892417:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301806208 00000100:00100000:2.0:1788813455.892431:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301806208 00000100:00100000:2.0:1788813455.892535:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 26 00000100:00100000:2.0:1788813455.892551:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+5:18713:x1875706301806208:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788813455.894022:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788813455.898957:0:25305:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6318us 00000100:00100000:0.0:1788813455.922574:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+5:18713:x1875706301806208:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 Request processed in 30020us (30733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813455.922589:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 26 00000100:00100000:1.0:1788813455.968395:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813455.968511:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301806336 00000100:00100000:2.0:1788813455.968522:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301806336 00000100:00100000:2.0:1788813455.968584:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 27 00000100:00100000:2.0:1788813455.968596:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+9:18719:x1875706301806336:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813455.968615:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813455.968637:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704a71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729d7a expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968704:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968718:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968730:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968744:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704a7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968764:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704a7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968771:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704a7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968819:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968826:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a78 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968833:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968839:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a80e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813455.968843:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968851:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968862:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6e8e4900) 00010000:00010000:2.0:1788813455.968865:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813455.968870:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968877:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704a78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968892:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704a7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968905:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704a7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968910:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704a7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968915:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a81000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813455.968918:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704a7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968924:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704a7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.968992:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff948942ffbc00) 00010000:00010000:2.0:1788813455.968995:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813455.968997:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704a7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.969003:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704a7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.969035:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704a71 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d7a expref: 10 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.969045:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6e8e4900) 00010000:00010000:2.0:1788813455.969047:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813455.969050:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704a71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d7a expref: 10 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813455.969069:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948941a81e00, rc 0) 00000100:00100000:2.0:1788813455.969122:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+9:18719:x1875706301806336:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 529us (737us total) trans 0 rc 301/301 00000100:00100000:2.0:1788813455.969130:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 27 00000100:00100000:2.0:1788813455.978839:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813455.978999:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301806464 00000100:00100000:3.0:1788813455.979012:0:22732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301806464 00000100:00100000:3.0:1788813455.979092:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:3.0:1788813455.979104:0:22732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7492b028-cad1-4968-b6ea-0072cb2dae48+9:18719:x1875706301806464:12345-192.168.202.13@tcp:700:lfs.0 00000100:00100000:3.0:1788813455.979208:0:22732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7492b028-cad1-4968-b6ea-0072cb2dae48+9:18719:x1875706301806464:12345-192.168.202.13@tcp:700:lfs.0 Request processed in 107us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813455.979233:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:0.0:1788813455.987315:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813455.987401:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301806720 00000100:00100000:3.0:1788813455.987412:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301806720 00000100:00100000:3.0:1788813455.987485:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:3.0:1788813455.987495:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+9:18719:x1875706301806720:12345-192.168.202.13@tcp:36:lfs.0 00010000:00010000:3.0:1788813455.987556:0:22725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813455.987585:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff70499f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ce7 expref: 9 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.987603:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6e8e4900) 00010000:00010000:3.0:1788813455.987609:0:22725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813455.987671:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a86 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.987686:0:22725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7049de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d57 expref: 5 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.987694:0:22725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a86 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.987728:0:22725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7049de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d57 expref: 5 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.987743:0:22725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7049de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d57 expref: 5 pid: 25305 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813455.987759:0:22725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944026a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22725:1875706313441664:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813455.988418:0:22725:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489434b16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813455.993684:0:22725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944026a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22725:1875706313441664:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813455.993719:0:22725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a86 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813455.993791:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813455.993869:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301806848 00000100:00100000:0.0:1788813455.993877:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301806848 00010000:00010000:0.0:1788813455.993965:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7049de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d57 expref: 6 pid: 25305 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813455.994007:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:0.0:1788813455.994018:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:2397:x1875706301806848:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813455.994043:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813455.994050:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7049de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d57 expref: 6 pid: 25305 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.994062:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7049de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d57 expref: 6 pid: 25305 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.994084:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7049de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d57 expref: 6 pid: 25305 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.994098:0:22708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6e8e4900) 00010000:00010000:0.0:1788813455.994103:0:22708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a86 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.994112:0:22708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.994120:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a86 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813455.994142:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813455.994217:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2397:x1875706301806848:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 200us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813455.994225:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15 00010000:00010000:3.0:1788813455.994841:0:22725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.994851:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.994875:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a8d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.994885:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.994893:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788813455.995841:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788813455.996612:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a94 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.996629:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a94 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.996640:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a94 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813455.996657:0:22725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081564b3e reply state 00000000046d99f9 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a94 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.996687:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a94 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.996695:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948a6fe50300) 00010000:00010000:3.0:1788813455.996698:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788813455.996701:0:22725:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788813455.996707:0:22725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788813455.996716:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.996723:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a86 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.996730:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a86 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.996736:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813455.996741:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a86 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.996749:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a86 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.996757:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6e8e4900) 00010000:00010000:3.0:1788813455.996760:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813455.996765:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a86 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.996772:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704a86 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813455.996797:0:22725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081564b3e reply state 00000000046d99f9 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.996805:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813455.996812:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff948a6fe50c00) 00010000:00010000:3.0:1788813455.996814:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788813455.996816:0:22725:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788813455.996919:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+10:18719:x1875706301806720:12345-192.168.202.13@tcp:36:lfs.0 Request processed in 9422us (9615us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788813455.996929:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:0.0:1788813456.102587:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813456.103140:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301806976 00000100:00100000:2.0:1788813456.103248:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301806976 00000100:00100000:2.0:1788813456.103386:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00100000:2.0:1788813456.103399:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+10:18727:x1875706301806976:12345-192.168.202.13@tcp:101:lctl.0 00010000:00010000:2.0:1788813456.103433:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813456.103464:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704a9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729d81 expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.103551:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704aa2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.103569:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.103583:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813456.103783:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788813456.103788:0:22723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788813456.103838:0:22723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.103869:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704a9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d81 expref: 12 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.104046:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81000/0xf32533d6ff704aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d81 expref: 11 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.104056:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948942ffbc00) 00010000:00010000:2.0:1788813456.104059:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813456.104064:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948941a81000, rc 0) 00000100:00100000:2.0:1788813456.104151:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+11:18727:x1875706301806976:12345-192.168.202.13@tcp:101:lctl.0 Request processed in 755us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813456.104168:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00100000:0.0:1788813456.140139:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813456.140761:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301807104 00000100:00100000:2.0:1788813456.140777:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301807104 00000100:00100000:2.0:1788813456.140866:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:2.0:1788813456.140880:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:18728:x1875706301807104:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813456.140920:0:25305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813456.141292:0:25305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704aa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729d88 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.141383:0:25305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704ab0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.141401:0:25305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.141417:0:25305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813456.141471:0:25305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788813456.141493:0:25305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788813456.141525:0:25305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.141557:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704aa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d88 expref: 7 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.141580:0:25305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a80e00/0xf32533d6ff704ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d88 expref: 6 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.141590:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948942ffbc00) 00010000:00010000:2.0:1788813456.141594:0:25305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813456.141598:0:25305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948941a80e00, rc 0) 00000100:00100000:2.0:1788813456.142610:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:18728:x1875706301807104:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 1726us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813456.142622:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:0.0:1788813456.147623:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813456.147853:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301807232 00000100:00100000:3.0:1788813456.147867:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301807232 00000100:00100000:3.0:1788813456.148425:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:3.0:1788813456.148441:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:18728:x1875706301807232:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813456.148472:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813456.148499:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704ab7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729d8f expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.148585:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704abe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.148603:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704abe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.148618:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704abe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.148772:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704ac5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.148782:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.148790:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.148909:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704acc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.148919:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704acc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.148926:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704acc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813456.149004:0:22724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788813456.149009:0:22724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813456.149034:0:22724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704acc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149048:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704abe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149056:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704abe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149063:0:22724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704abe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149079:0:22724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813456.149085:0:22724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704abe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149093:0:22724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704abe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149119:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948942ffbc00) 00010000:00010000:3.0:1788813456.149123:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813456.149129:0:22724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704abe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149135:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704abe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149151:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149272:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704ac5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149279:0:22724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149284:0:22724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813456.149287:0:22724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149294:0:22724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149312:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff948a6fe50c00) 00010000:00010000:3.0:1788813456.149314:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813456.149318:0:22724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704ac5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149324:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704ac5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149357:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704ab7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d8f expref: 8 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149371:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704acc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d8f expref: 7 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.149377:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948a6fe50300) 00010000:00010000:3.0:1788813456.149380:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813456.149382:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08c00, rc 0) 00000100:00100000:3.0:1788813456.149483:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+7:18728:x1875706301807232:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 1048us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813456.149491:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:1.0:1788813456.155358:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813456.155468:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301807360 00000100:00100000:0.0:1788813456.155485:0:22734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301807360 00000100:00080000:1.0:1788813456.155989:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813456.155991:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00100000:0.0:1788813456.156026:0:22734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:18728:x1875706301807360:12345-192.168.202.13@tcp:900:lfs.0 00000100:00100000:1.0:1788813456.156269:0:22734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:18728:x1875706301807360:12345-192.168.202.13@tcp:900:lfs.0 Request processed in 259us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813456.156278:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00100000:0.0:1788813456.159855:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813456.159924:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301807616 00000100:00100000:3.0:1788813456.159960:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301807616 00000100:00100000:3.0:1788813456.160014:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 32 00000100:00100000:3.0:1788813456.160024:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+7:18728:x1875706301807616:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813456.160046:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813456.160067:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704ad3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729d96 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813456.160260:0:22725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788813456.160382:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704ad3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d96 expref: 9 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.160398:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948942ffbc00) 00010000:00010000:3.0:1788813456.160402:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813456.160407:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704ad3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d96 expref: 9 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.160421:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08e00, rc 0) 00000100:00100000:3.0:1788813456.160483:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+8:18728:x1875706301807616:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 460us (637us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1788813456.160491:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 32 00000100:00100000:0.0:1788813456.167557:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813456.168276:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301807872 00000100:00100000:2.0:1788813456.168288:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301807872 00000100:00100000:2.0:1788813456.168389:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 33 00000100:00100000:2.0:1788813456.168401:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+8:18728:x1875706301807872:12345-192.168.202.13@tcp:36:lfs.0 00010000:00010000:2.0:1788813456.168459:0:22723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813456.168487:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704acc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d8f expref: 8 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.168507:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948a6fe50300) 00010000:00010000:2.0:1788813456.168512:0:22723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813456.168537:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704ae1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.168573:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704ae1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.168584:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704ae1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813456.170107:0:22723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001264624d reply state 000000006b8c5081 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704ae1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.170130:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704ae1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.170139:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948a6fe50300) 00010000:00010000:2.0:1788813456.170142:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788813456.170146:0:22723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788813456.170515:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788813456.171279:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+9:18728:x1875706301807872:12345-192.168.202.13@tcp:36:lfs.0 Request processed in 2273us (3121us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788813456.171290:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 33 00000100:00100000:1.0:1788813456.179875:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813456.180364:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301808128 00000100:00100000:2.0:1788813456.180375:0:22726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301808128 00000100:00100000:2.0:1788813456.180468:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2 00000100:00100000:2.0:1788813456.180480:0:22726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+9:18728:x1875706301808128:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813456.180837:0:22726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+10:18728:x1875706301808128:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 358us (972us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788813456.180845:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2 00000100:00100000:1.0:1788813456.186754:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813456.186985:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301808384 00000100:00100000:2.0:1788813456.186997:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301808384 00000100:00100000:2.0:1788813456.187212:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 34 00000100:00100000:2.0:1788813456.187224:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+10:18728:x1875706301808384:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813456.187248:0:25305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813456.187285:0:25305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea800/0xf32533d6ff704ae8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729d9d expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187370:0:25305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ebc00/0xf32533d6ff704aef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187383:0:25305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ebc00/0xf32533d6ff704aef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187394:0:25305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ebc00/0xf32533d6ff704aef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187405:0:25305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea400/0xf32533d6ff704af6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187414:0:25305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea400/0xf32533d6ff704af6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187420:0:25305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea400/0xf32533d6ff704af6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813456.187531:0:25305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788813456.187602:0:25305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ebc00/0xf32533d6ff704aef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187610:0:25305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ebc00/0xf32533d6ff704aef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187617:0:25305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ebc00/0xf32533d6ff704aef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187643:0:25305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a5e7ebc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813456.187647:0:25305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ebc00/0xf32533d6ff704aef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187655:0:25305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ebc00/0xf32533d6ff704aef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187668:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948942ffbc00) 00010000:00010000:2.0:1788813456.187671:0:25305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813456.187812:0:25305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ebc00/0xf32533d6ff704aef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187818:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ebc00/0xf32533d6ff704aef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187833:0:25305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea400/0xf32533d6ff704af6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187839:0:25305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea400/0xf32533d6ff704af6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187845:0:25305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea400/0xf32533d6ff704af6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187850:0:25305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a5e7ea400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813456.187852:0:25305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea400/0xf32533d6ff704af6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187858:0:25305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea400/0xf32533d6ff704af6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187876:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff948a6fe50c00) 00010000:00010000:2.0:1788813456.187878:0:25305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813456.187881:0:25305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea400/0xf32533d6ff704af6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.187886:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea400/0xf32533d6ff704af6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.188345:0:25305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea800/0xf32533d6ff704ae8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d9d expref: 12 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.188356:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948942ffbc00) 00010000:00010000:2.0:1788813456.188358:0:25305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813456.188362:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea800/0xf32533d6ff704ae8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729d9d expref: 12 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.188371:0:25305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a5e7ea800, rc 0) 00000100:00100000:2.0:1788813456.188435:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+11:18728:x1875706301808384:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 1214us (1768us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1788813456.188443:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 34 00000100:00100000:1.0:1788813456.192795:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813456.193081:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301808512 00000100:00100000:3.0:1788813456.193092:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301808512 00000100:00100000:3.0:1788813456.193162:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 35 00000100:00100000:3.0:1788813456.193173:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+11:18728:x1875706301808512:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813456.193207:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813456.193230:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704b04 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729da4 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.193327:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b0b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.193342:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b0b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.193372:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b0b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813456.193400:0:22724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788813456.193403:0:22724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813456.193423:0:22724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b0b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.193451:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704b04 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729da4 expref: 13 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.193468:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b0b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729da4 expref: 12 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.193477:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948a6fe50300) 00010000:00010000:3.0:1788813456.193480:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813456.193484:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09600, rc 0) 00000100:00100000:3.0:1788813456.193552:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+12:18728:x1875706301808512:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 381us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813456.193560:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 35 00000100:00100000:1.0:1788813456.206824:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813456.206974:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301808640 00000100:00100000:3.0:1788813456.206985:0:22727:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301808640 00000100:00100000:3.0:1788813456.207039:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:3.0:1788813456.207050:0:22727:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+12:18728:x1875706301808640:12345-192.168.202.13@tcp:37:lfs.0 00000100:00100000:2.0:1788813456.241647:0:22727:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+12:18728:x1875706301808640:12345-192.168.202.13@tcp:37:lfs.0 Request processed in 34587us (34821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813456.241661:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:1.0:1788813456.247007:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813456.247806:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301808896 00000100:00100000:2.0:1788813456.247818:0:22726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301808896 00000100:00100000:2.0:1788813456.247901:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4 00000100:00100000:2.0:1788813456.247912:0:22726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a5e226c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+12:18728:x1875706301808896:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813456.249737:0:22726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a5e226c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+13:18728:x1875706301808896:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 1816us (2729us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788813456.249750:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4 00010000:00010000:3.0:1788813456.293703:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813456.350926:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813456.351791:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301809024 00000100:00100000:3.0:1788813456.351802:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301809024 00000100:00100000:1.0:1788813456.351984:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 36 00000100:00100000:1.0:1788813456.351998:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+11:18735:x1875706301809024:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:1.0:1788813456.352020:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813456.352052:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704b12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729dab expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352116:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff704b19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352131:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff704b19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352143:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff704b19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352445:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff704b20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352455:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff704b20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352463:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff704b20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352546:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff704b27 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352564:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff704b27 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352571:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff704b27 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813456.352608:0:22725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788813456.352612:0:22725:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788813456.352652:0:22725:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff704b27 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352664:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff704b19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352671:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff704b19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352677:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff704b19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352683:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dada00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813456.352688:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff704b19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352695:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff704b19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352706:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948942ffbc00) 00010000:00010000:1.0:1788813456.352710:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813456.352714:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff704b19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352731:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff704b19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352748:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff704b20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352754:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff704b20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352759:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff704b20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352764:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813456.352767:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff704b20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352773:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff704b20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352780:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff948a6fe50c00) 00010000:00010000:1.0:1788813456.352783:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813456.352786:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff704b20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352792:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff704b20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352816:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704b12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dab expref: 13 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352840:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff704b27 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dab expref: 12 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.352847:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948a6fe50300) 00010000:00010000:1.0:1788813456.352849:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788813456.352852:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dacc00, rc 0) 00000100:00100000:1.0:1788813456.353136:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+12:18735:x1875706301809024:12345-192.168.202.13@tcp:101:bash.0 Request processed in 1139us (2217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813456.353143:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 36 00000100:00100000:2.0:1788813456.357242:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813456.357451:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301809152 00000100:00100000:3.0:1788813456.357462:0:22735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301809152 00000100:00100000:3.0:1788813456.357552:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:3.0:1788813456.357564:0:22735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7492b028-cad1-4968-b6ea-0072cb2dae48+5:18735:x1875706301809152:12345-192.168.202.13@tcp:900:bash.0 00000100:00100000:3.0:1788813456.357654:0:22735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7492b028-cad1-4968-b6ea-0072cb2dae48+5:18735:x1875706301809152:12345-192.168.202.13@tcp:900:bash.0 Request processed in 93us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813456.357661:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:2.0:1788813456.361430:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813456.361528:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301809408 00000100:00100000:0.0:1788813456.361539:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301809408 00000100:00100000:0.0:1788813456.361598:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 37 00000100:00100000:0.0:1788813456.361608:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+12:18735:x1875706301809408:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813456.361627:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813456.361648:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff704b2e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729db2 expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.361757:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704b35 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.361774:0:22723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b0b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729da4 expref: 12 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.361783:0:22723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704b35 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.361816:0:22723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b0b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729da4 expref: 12 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.361830:0:22723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b0b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729da4 expref: 12 pid: 22724 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813456.361844:0:22723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22723:1875706313441792:192.168.202.13@tcp:104: 00000100:00100000:0.0:1788813456.361972:0:22723:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ebfd600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813456.365487:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813456.365677:0:22723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22723:1875706313441792:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813456.365706:0:22723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704b35 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813456.365782:0:25754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301809536 00000100:00100000:3.0:1788813456.365792:0:25754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301809536 00010000:00010000:3.0:1788813456.365834:0:25754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b0b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729da4 expref: 13 pid: 22724 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813456.365878:0:25754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:3.0:1788813456.365888:0:25754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+13:2397:x1875706301809536:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813456.365918:0:25754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813456.365926:0:25754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b0b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729da4 expref: 13 pid: 22724 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.365977:0:25754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b0b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729da4 expref: 13 pid: 22724 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.366002:0:25754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b0b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729da4 expref: 13 pid: 22724 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.366020:0:25754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948a6fe50300) 00010000:00010000:3.0:1788813456.366025:0:25754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704b35 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.366058:0:25754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704b35 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.366067:0:25754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704b35 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.366086:0:25754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813456.366143:0:25754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+12:2397:x1875706301809536:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 256us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813456.366161:0:25754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 16 00010000:00010000:0.0:1788813456.366276:0:22723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704b35 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.366284:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704b35 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.366332:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff704b3c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.366343:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff704b3c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.366351:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff704b3c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.366842:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda400/0xf32533d6ff704b43 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.366852:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda400/0xf32533d6ff704b43 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.366861:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda400/0xf32533d6ff704b43 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813456.366871:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788813456.366897:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704b35 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.366919:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704b35 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.366926:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704b35 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.366975:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813456.366980:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704b35 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.366989:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704b35 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.366999:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948a6fe50300) 00010000:00010000:0.0:1788813456.367002:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813456.367007:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704b35 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.367013:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704b35 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813456.367026:0:22723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e560a0de reply state 00000000d96232cc transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff704b3c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.367037:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff704b3c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.367043:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff948a6aed9000) 00010000:00010000:0.0:1788813456.367045:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788813456.367048:0:22723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788813456.367082:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff704b2e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729db2 expref: 15 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.367103:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda400/0xf32533d6ff704b43 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729db2 expref: 14 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.367110:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:0.0:1788813456.367112:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788813456.367115:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cda400, rc 0) 00000100:00100000:0.0:1788813456.367161:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+15:18735:x1875706301809408:12345-192.168.202.13@tcp:101:bash.0 Request processed in 5544us (5796us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788813456.367169:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 37 00000100:00100000:1.0:1788813456.380913:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813456.381025:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301809664 00000100:00100000:3.0:1788813456.381035:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301809664 00000100:00100000:3.0:1788813456.381100:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 38 00000100:00100000:3.0:1788813456.381112:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+15:18735:x1875706301809664:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:3.0:1788813456.381136:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813456.381167:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b51 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729db9 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.381243:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704b58 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.381257:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704b58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.381267:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704b58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813456.381316:0:22724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788813456.381321:0:22724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813456.381464:0:22724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704b58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.381475:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704b58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.381501:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b51 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729db9 expref: 17 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.381519:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704b58 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729db9 expref: 16 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.381528:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:3.0:1788813456.381531:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813456.381535:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08e00, rc 0) 00000100:00100000:3.0:1788813456.381648:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+16:18735:x1875706301809664:12345-192.168.202.13@tcp:101:bash.0 Request processed in 539us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813456.381655:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 38 00000100:00100000:1.0:1788813456.386760:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813456.386857:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301809920 00000100:00100000:2.0:1788813456.386868:0:22727:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301809920 00000100:00100000:2.0:1788813456.387134:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:2.0:1788813456.387144:0:22727:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+16:18735:x1875706301809920:12345-192.168.202.13@tcp:35:bash.0 00000100:00100000:2.0:1788813456.387625:0:22727:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+17:18735:x1875706301809920:12345-192.168.202.13@tcp:35:bash.0 Request processed in 481us (873us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788813456.387634:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 5 00000040:00080000:2.0:1788813456.486077:0:23477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788813456.510062:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813456.510142:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301810176 00000100:00100000:3.0:1788813456.510153:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301810176 00000100:00100000:3.0:1788813456.510235:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 39 00000100:00100000:3.0:1788813456.510247:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+17:18745:x1875706301810176:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813456.510273:0:25305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813456.510308:0:25305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704b5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729dc0 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813456.510422:0:25305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788813456.510523:0:25305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704b5f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dc0 expref: 19 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.510558:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948942ffbc00) 00010000:00010000:3.0:1788813456.510561:0:25305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813456.510567:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704b5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dc0 expref: 19 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.510581:0:25305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09000, rc 0) 00000100:00100000:3.0:1788813456.510650:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+18:18745:x1875706301810176:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 405us (599us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1788813456.510658:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 39 00000100:00100000:3.0:1788813456.519139:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813456.519280:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301810432 00000100:00100000:1.0:1788813456.519291:0:22726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301810432 00000100:00100000:1.0:1788813456.519365:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00100000:1.0:1788813456.519376:0:22726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+18:18745:x1875706301810432:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813456.519789:0:22726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+19:18745:x1875706301810432:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 413us (670us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788813456.519797:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00100000:1.0:1788813456.603832:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813456.603984:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301810688 00000100:00100000:3.0:1788813456.603995:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301810688 00000100:00100000:3.0:1788813456.604061:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 40 00000100:00100000:3.0:1788813456.604073:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+19:18748:x1875706301810688:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813456.604099:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813456.604123:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704b6d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729dc7 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.604263:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b74 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.604278:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b74 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.604290:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b74 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813456.604319:0:22724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788813456.604427:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704b6d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dc7 expref: 22 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.604447:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b74 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dc7 expref: 21 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813456.604455:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:3.0:1788813456.604457:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813456.604461:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09600, rc 0) 00000100:00100000:3.0:1788813456.604533:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+21:18748:x1875706301810688:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 462us (710us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788813456.604540:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 40 00000040:00080000:2.0:1788813456.612684:0:22759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788813456.616712:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813456.616962:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301810816 00000100:00100000:2.0:1788813456.616972:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301810816 00000100:00100000:2.0:1788813456.617038:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 41 00000100:00100000:2.0:1788813456.617049:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+21:18748:x1875706301810816:12345-192.168.202.13@tcp:54:lfs.0 00010000:00010000:2.0:1788813456.617114:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704b82 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.617131:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704b82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.617142:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704b82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.617210:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704b82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.617218:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704b82 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.617224:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704b82 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.617230:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a5e7ea600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813456.617233:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704b82 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.617241:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704b82 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.617253:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:2.0:1788813456.617256:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813456.617261:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704b82 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.617267:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704b82 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813456.617345:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+21:18748:x1875706301810816:12345-192.168.202.13@tcp:54:lfs.0 Request processed in 298us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813456.617663:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 41 00000100:00100000:0.0:1788813456.620168:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813456.620325:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301810944 00000100:00100000:1.0:1788813456.620335:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301810944 00000100:00100000:1.0:1788813456.620407:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:1.0:1788813456.620417:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+21:2397:x1875706301810944:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813456.620435:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813456.620467:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704b74 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dc7 expref: 21 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813456.620487:0:22708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:1.0:1788813456.620493:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813456.620564:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+20:2397:x1875706301810944:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 148us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813456.620572:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:1.0:1788813456.636633:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813456.636790:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301811200 00000100:00100000:2.0:1788813456.636800:0:22727:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301811200 00000100:00100000:2.0:1788813456.636860:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:2.0:1788813456.636897:0:22727:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+20:18748:x1875706301811200:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813456.637165:0:22727:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+21:18748:x1875706301811200:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 281us (542us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788813456.637173:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:0.0:1788813457.040106:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813457.040222:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301811456 00000100:00100000:3.0:1788813457.040233:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301811456 00000100:00100000:3.0:1788813457.040328:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 42 00000100:00100000:3.0:1788813457.040340:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+21:18779:x1875706301811456:12345-192.168.202.13@tcp:101:cat.0 00010000:00010000:3.0:1788813457.040364:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813457.040385:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704b89 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729dce expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813457.040499:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704b90 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813457.040513:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704b90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813457.040543:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704b90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813457.040555:0:22724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788813457.040692:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704b89 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dce expref: 24 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813457.040712:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704b90 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dce expref: 23 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813457.040720:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:3.0:1788813457.040724:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813457.040727:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08800, rc 0) 00000100:00100000:3.0:1788813457.040792:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+23:18779:x1875706301811456:12345-192.168.202.13@tcp:101:cat.0 Request processed in 455us (696us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1788813457.040800:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 42 00000100:00080000:1.0:1788813457.041199:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813457.045493:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813457.045607:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813457.046398:0:25754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301811840 00000100:00100000:0.0:1788813457.046410:0:25754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301811840 00000100:00100000:0.0:1788813457.046482:0:25754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 1 00000100:00100000:0.0:1788813457.046492:0:25754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+23:2396:x1875706301811840:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813457.046507:0:25754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813457.046532:0:25754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704b90 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dce expref: 23 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.046551:0:25754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:0.0:1788813457.046556:0:25754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813457.046631:0:25754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+22:2396:x1875706301811840:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 140us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813457.046638:0:25754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 1 00000100:00100000:2.0:1788813457.053442:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301811712 00000100:00100000:2.0:1788813457.053460:0:22727:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301811712 00000100:00100000:3.0:1788813457.054153:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:3.0:1788813457.054167:0:22727:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+22:18779:x1875706301811712:12345-192.168.202.13@tcp:35:cat.0 00000100:00100000:3.0:1788813457.054516:0:22727:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+23:18779:x1875706301811712:12345-192.168.202.13@tcp:35:cat.0 Request processed in 350us (9031us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1788813457.054524:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:3.0:1788813457.189766:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813457.190511:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301812096 00000100:00100000:0.0:1788813457.190524:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301812096 00000100:00100000:0.0:1788813457.190714:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 43 00000100:00100000:0.0:1788813457.190726:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+23:18785:x1875706301812096:12345-192.168.202.13@tcp:101:dd.0 00010000:00010000:0.0:1788813457.190753:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813457.190777:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff704b9e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729dd5 expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.190906:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704ba5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.190922:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704ba5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.190983:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704ba5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813457.190996:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788813457.191443:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff704b9e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dd5 expref: 26 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.191464:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704ba5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dd5 expref: 25 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.191473:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:0.0:1788813457.191476:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813457.191480:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdb800, rc 0) 00000100:00100000:0.0:1788813457.191779:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+25:18785:x1875706301812096:12345-192.168.202.13@tcp:101:dd.0 Request processed in 1054us (2024us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788813457.191807:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 43 00000100:00100000:2.0:1788813457.197570:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813457.197757:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301812224 00000100:00100000:1.0:1788813457.197769:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301812224 00000100:00100000:1.0:1788813457.198081:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 44 00000100:00100000:1.0:1788813457.198093:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+25:18785:x1875706301812224:12345-192.168.202.13@tcp:101:dd.0 00010000:00010000:1.0:1788813457.198118:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813457.198139:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff704bb3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729ddc expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813457.198196:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff704bba lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813457.198212:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff704bba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813457.198224:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff704bba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813457.198347:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff704bb3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ddc expref: 27 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813457.198377:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff704bba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ddc expref: 26 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813457.198385:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:1.0:1788813457.198389:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788813457.198392:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43daca00, rc 0) 00000100:00100000:1.0:1788813457.198459:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+26:18785:x1875706301812224:12345-192.168.202.13@tcp:101:dd.0 Request processed in 369us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813457.198467:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 44 00000100:00100000:0.0:1788813457.209301:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813457.209338:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813457.212823:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301812352 00000100:00100000:2.0:1788813457.212842:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301812352 00000100:00100000:2.0:1788813457.212965:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2 00000100:00100000:2.0:1788813457.212980:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d680a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+26:2396:x1875706301812352:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813457.213003:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813457.213030:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704ba5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dd5 expref: 26 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813457.213056:0:22708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:2.0:1788813457.213062:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813457.213138:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d680a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+25:2396:x1875706301812352:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 162us (3848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813457.213145:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2 00000100:00100000:3.0:1788813457.213844:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301812608 00000100:00100000:3.0:1788813457.213852:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301812608 00000100:00100000:3.0:1788813457.213921:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 45 00000100:00100000:3.0:1788813457.213963:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+25:18785:x1875706301812608:12345-192.168.202.13@tcp:36:dd.0 00010000:00010000:3.0:1788813457.214018:0:25305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813457.214036:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704b58 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729db9 expref: 25 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813457.214051:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:3.0:1788813457.214055:0:25305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813457.214237:0:25305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704bc1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813457.214251:0:25305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704bc1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813457.214260:0:25305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704bc1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813457.214306:0:25305:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1788813457.214328:0:25305:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009bfb42dc reply state 00000000c69e0bc7 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704bc1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813457.214341:0:25305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704bc1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813457.214347:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:3.0:1788813457.214349:0:25305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788813457.214352:0:25305:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813457.214433:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+27:18785:x1875706301812608:12345-192.168.202.13@tcp:36:dd.0 Request processed in 504us (5094us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1788813457.214440:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 45 00000020:00080000:3.0:1788813457.214452:0:25305:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788813457.281411:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813457.281717:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301812736 00000100:00100000:2.0:1788813457.281727:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301812736 00000100:00100000:2.0:1788813457.281838:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 169 00000100:00100000:2.0:1788813457.281849:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+13:2397:x1875706301812736:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813457.281962:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+13:2397:x1875706301812736:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 85us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813457.281989:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 169 00000100:00100000:0.0:1788813457.285259:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813457.285310:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813457.285339:0:25304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301813120 00000100:00100000:0.0:1788813457.285347:0:25304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301813120 00000100:00100000:0.0:1788813457.285412:0:25304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:0.0:1788813457.285422:0:25304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2396:x1875706301813120:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813457.285485:0:25304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2396:x1875706301813120:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 65us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813457.285492:0:25304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:0.0:1788813457.285529:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813457.285593:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813457.285609:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301813632 00000100:00100000:0.0:1788813457.285613:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301813632 00000100:00100000:0.0:1788813457.285638:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:0.0:1788813457.285645:0:24228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2396:x1875706301813632:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813457.285891:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301812864 00000100:00100000:3.0:1788813457.285896:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301812864 00000100:00100000:3.0:1788813457.285959:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301813376 00000100:00100000:3.0:1788813457.285963:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301813376 00000100:00100000:3.0:1788813457.285985:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:3.0:1788813457.285992:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2396:x1875706301812864:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813457.286068:0:24228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2396:x1875706301813632:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 423us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813457.286075:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00080000:1.0:1788813457.286317:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788813457.286323:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813457.286433:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 66 00000100:00100000:2.0:1788813457.286444:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2396:x1875706301813376:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813457.287034:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2396:x1875706301812864:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 1039us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813457.287042:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:0.0:1788813457.287477:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813457.287508:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813457.287532:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813457.287568:0:25304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301812992 00000100:00100000:0.0:1788813457.287574:0:25304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301812992 00000100:00100000:0.0:1788813457.287612:0:25304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301813504 00000100:00100000:0.0:1788813457.287615:0:25304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301813504 00000100:00100000:0.0:1788813457.287638:0:25304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:0.0:1788813457.287645:0:25304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2397:x1875706301812992:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813457.287766:0:24816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 26 00000100:00100000:3.0:1788813457.287775:0:24816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2397:x1875706301813504:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813457.287819:0:24816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2397:x1875706301813504:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 46us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813457.287825:0:24816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 26 00000100:00080000:3.0:1788813457.287862:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813457.287870:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301813248 00000100:00100000:3.0:1788813457.287874:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301813248 00000100:00080000:3.0:1788813457.287889:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813457.287912:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:3.0:1788813457.287919:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+12:2397:x1875706301813248:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813457.287969:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+12:2397:x1875706301813248:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 51us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813457.287975:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:0.0:1788813457.288112:0:25304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2397:x1875706301812992:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 467us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813457.288119:0:25304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:2.0:1788813457.289328:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2396:x1875706301813376:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 2877us (3789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813457.289340:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 66 00010000:00010000:2.0:1788813457.316704:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813457.382416:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813457.382518:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301813888 00000100:00100000:3.0:1788813457.382530:0:22727:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301813888 00000100:00100000:3.0:1788813457.382592:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:3.0:1788813457.382630:0:22727:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+27:18785:x1875706301813888:12345-192.168.202.13@tcp:35:dd.0 00000100:00100000:3.0:1788813457.382909:0:22727:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+28:18785:x1875706301813888:12345-192.168.202.13@tcp:35:dd.0 Request processed in 291us (504us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1788813457.382917:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:3.0:1788813457.679338:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813457.679496:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301814016 00000100:00100000:0.0:1788813457.679513:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301814016 00000100:00100000:0.0:1788813457.679601:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00100000:0.0:1788813457.679614:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+28:18799:x1875706301814016:12345-192.168.202.13@tcp:101:stat.0 00010000:00010000:0.0:1788813457.679650:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813457.679681:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff704bc8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729de3 expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.679775:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704bcf lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.679795:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704bcf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.679809:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704bcf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.679822:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff704bd6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.679857:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff704bd6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.679865:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff704bd6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680004:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff704bdd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680014:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff704bdd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680022:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff704bdd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813457.680078:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788813457.680084:0:22723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813457.680136:0:22723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff704bdd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680150:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff704bdd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680160:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704bcf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680167:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704bcf lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680186:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704bcf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680205:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813457.680210:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704bcf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680219:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704bcf lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680234:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948a6fe50300) 00010000:00010000:0.0:1788813457.680237:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813457.680244:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704bcf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680250:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb800/0xf32533d6ff704bcf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680266:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff704bd6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680272:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff704bd6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680277:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff704bd6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680282:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdbe00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813457.680285:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff704bd6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680291:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff704bd6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680312:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff948a6aed9000) 00010000:00010000:0.0:1788813457.680315:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813457.680318:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff704bd6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680324:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff704bd6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680357:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff704bc8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729de3 expref: 30 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680374:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff704bdd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729de3 expref: 29 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813457.680382:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:0.0:1788813457.680384:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813457.680386:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9000, rc 0) 00000100:00100000:0.0:1788813457.680480:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+29:18799:x1875706301814016:12345-192.168.202.13@tcp:101:stat.0 Request processed in 869us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813457.680488:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00100000:2.0:1788813457.762446:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813457.762598:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301814272 00000100:00100000:3.0:1788813457.762616:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301814272 00000100:00100000:3.0:1788813457.762699:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 47 00000100:00100000:3.0:1788813457.762713:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+29:18805:x1875706301814272:12345-192.168.202.13@tcp:36:truncate.0 00010000:00010000:3.0:1788813457.762823:0:22725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813457.762860:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff704bdd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729de3 expref: 29 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813457.762889:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:3.0:1788813457.762896:0:22725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813457.763593:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704be4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813457.763617:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704be4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813457.763629:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704be4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813457.763683:0:22725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:3.0:1788813457.763707:0:22725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c272820 reply state 00000000abbc7d77 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704be4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813457.763721:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704be4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813457.763741:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:3.0:1788813457.763744:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788813457.763747:0:22725:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813457.766342:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+31:18805:x1875706301814272:12345-192.168.202.13@tcp:36:truncate.0 Request processed in 3612us (3892us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1788813457.766360:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 47 00000020:00080000:3.0:1788813457.766371:0:22725:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788813458.030291:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813458.030473:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301814400 00000100:00100000:0.0:1788813458.030487:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301814400 00000100:00100000:0.0:1788813458.030984:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 48 00000100:00100000:0.0:1788813458.031000:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+31:18819:x1875706301814400:12345-192.168.202.13@tcp:101:stat.0 00010000:00010000:0.0:1788813458.031039:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813458.031068:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff704beb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729dea expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031207:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff704bf2 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031229:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff704bf2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031248:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff704bf2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031263:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704bf9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031271:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704bf9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031278:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704bf9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031399:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c00 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031409:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031416:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813458.031477:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788813458.031482:0:22723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813458.031851:0:22723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031886:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031897:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff704bf2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031905:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff704bf2 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031913:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff704bf2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031920:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813458.031925:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff704bf2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031975:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff704bf2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.031990:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948a6fe50300) 00010000:00010000:0.0:1788813458.031993:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813458.032000:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff704bf2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.032007:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff704bf2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.032025:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704bf9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.032031:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704bf9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.032045:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704bf9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.032050:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813458.032053:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704bf9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.032060:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704bf9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.032068:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff948a6aed9000) 00010000:00010000:0.0:1788813458.032071:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813458.032187:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704bf9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.032195:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704bf9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.032244:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff704beb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dea expref: 33 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.032262:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c00 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dea expref: 32 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.032271:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:0.0:1788813458.032273:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813458.032276:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9800, rc 0) 00000100:00100000:0.0:1788813458.032456:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+32:18819:x1875706301814400:12345-192.168.202.13@tcp:101:stat.0 Request processed in 1459us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813458.032476:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 48 00000100:00100000:1.0:1788813458.154482:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813458.154593:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301814656 00000100:00100000:2.0:1788813458.154607:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301814656 00000100:00100000:2.0:1788813458.154687:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 49 00000100:00100000:2.0:1788813458.154700:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+32:18829:x1875706301814656:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813458.154879:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813458.154910:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea000/0xf32533d6ff704c07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729df1 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813458.155233:0:22724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788813458.155444:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea000/0xf32533d6ff704c07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729df1 expref: 34 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.155462:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948942ffbc00) 00010000:00010000:2.0:1788813458.155466:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813458.155472:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea000/0xf32533d6ff704c07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729df1 expref: 34 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.155490:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a5e7ea000, rc 0) 00000100:00100000:2.0:1788813458.155650:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+33:18829:x1875706301814656:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 952us (1182us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1788813458.155660:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 49 00000100:00100000:2.0:1788813458.161990:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813458.162100:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301814912 00000100:00100000:3.0:1788813458.162115:0:22727:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301814912 00000100:00100000:3.0:1788813458.162212:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:3.0:1788813458.162225:0:22727:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a5e225850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+33:18829:x1875706301814912:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:3.0:1788813458.163432:0:22727:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a5e225850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+34:18829:x1875706301814912:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 491us (739us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1788813458.163448:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:1.0:1788813458.257059:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813458.257255:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301815168 00000100:00100000:3.0:1788813458.257271:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301815168 00000100:00100000:3.0:1788813458.257369:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 50 00000100:00100000:3.0:1788813458.257381:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+34:18835:x1875706301815168:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:3.0:1788813458.257419:0:25305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813458.257448:0:25305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704c15 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729df8 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.257599:0:25305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.257617:0:25305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda400/0xf32533d6ff704b43 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729db2 expref: 35 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.257651:0:25305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c00 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dea expref: 35 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.257662:0:25305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.257705:0:25305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c00 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dea expref: 35 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.257722:0:25305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c00 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dea expref: 35 pid: 22723 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813458.257739:0:25305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944026a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25305:1875706313441920:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813458.257865:0:25305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda400/0xf32533d6ff704b43 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729db2 expref: 35 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.257887:0:25305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda400/0xf32533d6ff704b43 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729db2 expref: 35 pid: 22723 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813458.257896:0:25305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944025180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25305:1875706313442048:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813458.257921:0:25305:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813458.263182:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813458.263467:0:25305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944026a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25305:1875706313441920:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813458.263483:0:25305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944025180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25305:1875706313442048:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813458.263519:0:25305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813458.263644:0:25754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301815424 00000100:00100000:1.0:1788813458.263655:0:25754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301815424 00010000:00010000:1.0:1788813458.263708:0:25754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda400/0xf32533d6ff704b43 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729db2 expref: 36 pid: 22723 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813458.263756:0:25754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:1.0:1788813458.263766:0:25754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a74bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+36:2396:x1875706301815424:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813458.263786:0:25754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813458.263794:0:25754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda400/0xf32533d6ff704b43 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729db2 expref: 36 pid: 22723 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.263806:0:25754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda400/0xf32533d6ff704b43 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729db2 expref: 36 pid: 22723 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.263840:0:25754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda400/0xf32533d6ff704b43 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729db2 expref: 36 pid: 22723 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.263860:0:25754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:1.0:1788813458.263865:0:25754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.263876:0:25754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.263883:0:25754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813458.264011:0:25754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a74bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+35:2396:x1875706301815424:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 245us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813458.264020:0:25754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:2.0:1788813458.265472:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813458.265675:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301815296 00000100:00100000:0.0:1788813458.265685:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301815296 00010000:00010000:0.0:1788813458.265730:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c00 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dea expref: 35 pid: 22723 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813458.265775:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:0.0:1788813458.265787:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+35:2397:x1875706301815296:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813458.265805:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813458.265813:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c00 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dea expref: 35 pid: 22723 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.265827:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c00 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dea expref: 35 pid: 22723 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.265851:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c00 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dea expref: 35 pid: 22723 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.265869:0:22709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:0.0:1788813458.265876:0:22709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.265888:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.265897:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.265998:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813458.266287:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+34:2397:x1875706301815296:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 500us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813458.266296:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 18 00010000:00010000:3.0:1788813458.266465:0:25305:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.266476:0:25305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813458.266503:0:25305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1788813458.266690:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704c15 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729df8 expref: 35 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.266711:0:25305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729df8 expref: 34 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.266719:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:3.0:1788813458.266722:0:25305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788813458.266726:0:25305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08800, rc 0) 00000100:00100000:3.0:1788813458.266758:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+34:18835:x1875706301815168:12345-192.168.202.13@tcp:101:bash.0 Request processed in 9380us (9714us total) trans 12884901912 rc 0/0 00000100:00100000:3.0:1788813458.266767:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 50 00000100:00100000:2.0:1788813458.292163:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813458.292353:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301815680 00000100:00100000:3.0:1788813458.292367:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301815680 00000100:00100000:3.0:1788813458.292448:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 51 00000100:00100000:3.0:1788813458.292463:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+34:18835:x1875706301815680:12345-192.168.202.13@tcp:36:bash.0 00010000:00010000:3.0:1788813458.292796:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704c2a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.292819:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704c2a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.292855:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704c2a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813458.292913:0:22725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:3.0:1788813458.292979:0:22725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e2c1b6c reply state 0000000000486cfb transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704c2a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.292995:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704c2a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.293003:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:3.0:1788813458.293006:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788813458.293011:0:22725:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813458.293454:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+37:18835:x1875706301815680:12345-192.168.202.13@tcp:36:bash.0 Request processed in 993us (1307us total) trans 12884901914 rc 0/0 00000100:00100000:3.0:1788813458.293463:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 51 00000020:00080000:3.0:1788813458.293470:0:22725:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788813458.296592:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813458.296712:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301815808 00000100:00100000:0.0:1788813458.296725:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301815808 00000100:00100000:0.0:1788813458.296838:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 52 00000100:00100000:0.0:1788813458.296852:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+37:18835:x1875706301815808:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813458.296896:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813458.296927:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c31 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729dff expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.297041:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c31 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dff expref: 38 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.297055:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c31 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dff expref: 38 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.297083:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:0.0:1788813458.297086:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813458.297089:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9800, rc 0) 00000100:00100000:0.0:1788813458.297183:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+38:18835:x1875706301815808:12345-192.168.202.13@tcp:101:bash.0 Request processed in 333us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813458.297192:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 52 00000100:00100000:1.0:1788813458.303505:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813458.304316:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301815936 00000100:00100000:2.0:1788813458.304333:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301815936 00000100:00100000:2.0:1788813458.304420:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 53 00000100:00100000:2.0:1788813458.304433:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+38:18835:x1875706301815936:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:2.0:1788813458.304463:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813458.304840:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb400/0xf32533d6ff704c38 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729e06 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.306848:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb600/0xf32533d6ff704c3f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.306889:0:22724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729df8 expref: 39 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.306897:0:22724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb600/0xf32533d6ff704c3f lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.306959:0:22724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729df8 expref: 39 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.306975:0:22724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729df8 expref: 39 pid: 25305 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813458.307009:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22724:1875706313442176:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813458.310947:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813458.315682:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22724:1875706313442176:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813458.315700:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00010000:00010000:1.0:1788813458.315728:0:22724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb600/0xf32533d6ff704c3f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813458.315813:0:25754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301816064 00000100:00100000:0.0:1788813458.315824:0:25754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301816064 00010000:00010000:0.0:1788813458.315895:0:25754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729df8 expref: 40 pid: 25305 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813458.315978:0:25754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00100000:0.0:1788813458.315990:0:25754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eda7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+40:2397:x1875706301816064:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813458.316011:0:25754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813458.316020:0:25754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729df8 expref: 40 pid: 25305 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.316045:0:25754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729df8 expref: 40 pid: 25305 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.316074:0:25754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff704c1c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729df8 expref: 40 pid: 25305 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.316096:0:25754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:0.0:1788813458.316102:0:25754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb600/0xf32533d6ff704c3f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.316114:0:25754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb600/0xf32533d6ff704c3f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.316124:0:25754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb600/0xf32533d6ff704c3f lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.316155:0:25754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813458.316242:0:25754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eda7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+39:2397:x1875706301816064:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 253us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813458.316250:0:25754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 19 00010000:00010000:1.0:1788813458.316331:0:22724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb600/0xf32533d6ff704c3f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.316339:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb600/0xf32533d6ff704c3f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813458.316417:0:22724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788813458.316422:0:22724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788813458.316459:0:22724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb600/0xf32533d6ff704c3f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.316498:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb400/0xf32533d6ff704c38 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e06 expref: 39 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.316516:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb600/0xf32533d6ff704c3f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e06 expref: 38 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.316524:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:1.0:1788813458.316527:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813458.316530:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a5e7eb600, rc 0) 00000100:00100000:1.0:1788813458.316562:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+38:18835:x1875706301815936:12345-192.168.202.13@tcp:101:bash.0 Request processed in 12132us (13074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813458.316569:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 53 00000100:00100000:1.0:1788813458.320004:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813458.320256:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301816320 00000100:00100000:0.0:1788813458.320271:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301816320 00000100:00100000:0.0:1788813458.320359:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:0.0:1788813458.320372:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+38:18835:x1875706301816320:12345-192.168.202.13@tcp:103:bash.0 00010000:00010000:0.0:1788813458.320393:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788813458.320426:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c31 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729dff expref: 38 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.320457:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb600/0xf32533d6ff704c3f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e06 expref: 37 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.320470:0:22709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:0.0:1788813458.320477:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813458.320561:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+36:18835:x1875706301816320:12345-192.168.202.13@tcp:103:bash.0 Request processed in 191us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813458.320570:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:3.0:1788813458.327604:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813458.328261:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301816448 00000100:00100000:0.0:1788813458.328276:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301816448 00000100:00100000:0.0:1788813458.328479:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 54 00000100:00100000:0.0:1788813458.328492:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+36:18835:x1875706301816448:12345-192.168.202.13@tcp:58:bash.0 00010000:00010000:0.0:1788813458.328646:0:25305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704c46 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.328670:0:25305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704c46 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.328685:0:25305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704c46 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813458.333476:0:25305:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813458.333514:0:25305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788813458.333759:0:25305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788813458.334180:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+36:18835:x1875706301816448:12345-192.168.202.13@tcp:58:bash.0 Request processed in 5675us (6575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813458.334192:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 54 00000100:00100000:1.0:1788813458.340208:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00010000:00010000:3.0:1788813458.341188:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813458.345491:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301816576 00000100:00100000:0.0:1788813458.345509:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301816576 00000100:00100000:0.0:1788813458.345590:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 55 00000100:00100000:0.0:1788813458.345601:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+36:18835:x1875706301816576:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813458.345622:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813458.345643:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c4d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729e0d expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.345698:0:22725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704c46 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.345709:0:22725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c4d lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e0d expref: 37 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.345729:0:22725:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704c46 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.345741:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c4d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e0d expref: 37 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.345755:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:0.0:1788813458.345771:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813458.345776:0:22725:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c4d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e0d expref: 37 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.345784:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9800, rc 0) 00000100:00100000:0.0:1788813458.345855:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+37:18835:x1875706301816576:12345-192.168.202.13@tcp:101:bash.0 Request processed in 256us (5655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813458.345862:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 55 00000040:00080000:2.0:1788813458.661839:0:22759:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788813458.661850:0:22759:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813458.661902:0:22759:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788813458.661911:0:22759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788813458.662085:0:22759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22759:1875706313442304:192.168.202.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788813458.662162:0:22759:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813458.674682:0:22759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22759:1875706313442304:192.168.202.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788813458.678413:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813458.684444:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301816704 00000100:00100000:0.0:1788813458.684461:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301816704 00000100:00100000:0.0:1788813458.684539:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 56 00000100:00100000:0.0:1788813458.684551:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+37:18836:x1875706301816704:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788813458.684585:0:22723:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788813458.694522:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+37:18836:x1875706301816704:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 Request processed in 9959us (16104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813458.694538:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 56 00000100:00100000:1.0:1788813458.720797:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813458.721053:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301816832 00000100:00100000:3.0:1788813458.721064:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301816832 00000100:00100000:3.0:1788813458.721141:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 57 00000100:00100000:3.0:1788813458.721152:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+37:18836:x1875706301816832:12345-192.168.202.13@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788813458.721280:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704c54 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721299:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704c54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721327:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704c54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721366:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704c5b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721373:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704c5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721380:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704c5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721405:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704c62 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721415:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704c62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721423:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704c62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813458.721477:0:22725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788813458.721482:0:22725:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813458.721499:0:22725:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704c62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721510:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704c54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721795:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704c54 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721813:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704c54 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721819:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813458.721822:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704c54 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721830:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704c54 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721842:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948942ffb900) 00010000:00010000:3.0:1788813458.721846:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813458.721850:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704c54 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721857:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704c54 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721984:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704c5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721992:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704c5b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.721998:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704c5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.722004:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813458.722007:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704c5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.722025:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704c5b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.722034:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff948a6fe50000) 00010000:00010000:3.0:1788813458.722036:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813458.722039:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704c5b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.722045:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704c5b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.722062:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704c62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.722069:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704c62 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.722075:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704c62 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.722080:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813458.722083:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704c62 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.722090:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704c62 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.722096:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:3.0:1788813458.722099:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813458.722102:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704c62 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.722118:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704c62 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813458.724393:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+37:18836:x1875706301816832:12345-192.168.202.13@tcp:34:lhsmtool_posix.0 Request processed in 2352us (2716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813458.724413:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 57 00000100:00100000:3.0:1788813458.729880:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813458.732435:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301817088 00000100:00100000:1.0:1788813458.732453:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301817088 00000100:00100000:1.0:1788813458.732537:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 58 00000100:00100000:1.0:1788813458.732549:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+37:18836:x1875706301817088:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813458.732572:0:25305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813458.732596:0:25305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff704c69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729e14 expref: -99 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.732716:0:25305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c70 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.732731:0:25305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c70 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.732743:0:25305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c70 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813458.732753:0:25305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788813458.732828:0:25305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c70 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.732835:0:25305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c70 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.732842:0:25305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c70 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.732848:0:25305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813458.732852:0:25305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c70 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.732860:0:25305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c70 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.732872:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:1.0:1788813458.732875:0:25305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813458.732880:0:25305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c70 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.732896:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c70 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.732986:0:25305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff704c69 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e14 expref: 39 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.732998:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948942ffb900) 00010000:00010000:1.0:1788813458.733000:0:25305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813458.733004:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff704c69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e14 expref: 39 pid: 25305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.733016:0:25305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dad400, rc 0) 00000100:00100000:1.0:1788813458.733080:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+38:18836:x1875706301817088:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 534us (3218us total) trans 12884901915 rc 301/301 00000100:00100000:1.0:1788813458.733087:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 58 00000100:00100000:1.0:1788813458.741830:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813458.743091:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301817216 00000100:00100000:2.0:1788813458.743108:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301817216 00000100:00100000:2.0:1788813458.743202:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 59 00000100:00100000:2.0:1788813458.743213:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+38:18836:x1875706301817216:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788813458.743253:0:22724:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788813458.744025:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+38:18836:x1875706301817216:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 Request processed in 809us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813458.744034:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 59 00000100:00100000:1.0:1788813458.754162:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813458.754286:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301817472 00000100:00100000:3.0:1788813458.754298:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301817472 00000100:00100000:3.0:1788813458.754362:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 60 00000100:00100000:3.0:1788813458.754373:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+38:18836:x1875706301817472:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813458.754393:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813458.754414:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704c7e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729e1b expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788813458.754774:0:22723:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:3.0:1788813458.754781:0:22723:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:3.0:1788813458.754805:0:22723:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:3.0:1788813458.755351:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704c85 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.755366:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704c85 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.755378:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704c85 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.755442:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704c7e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e1b expref: 41 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.755476:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704c85 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e1b expref: 40 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.755485:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948a6fe50000) 00010000:00010000:3.0:1788813458.755489:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813458.755492:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08c00, rc 0) 00000100:00100000:3.0:1788813458.755640:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+40:18836:x1875706301817472:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 1268us (1486us total) trans 12884901916 rc 0/0 00000100:00100000:3.0:1788813458.755648:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 60 00000100:00100000:3.0:1788813458.776298:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813458.776536:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301817728 00000100:00100000:1.0:1788813458.776547:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301817728 00000100:00100000:1.0:1788813458.776682:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 61 00000100:00100000:1.0:1788813458.776694:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+40:18836:x1875706301817728:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788813458.776761:0:25305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813458.776794:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704c85 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e1b expref: 40 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.776818:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948a6fe50000) 00010000:00010000:1.0:1788813458.776840:0:25305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813458.776881:0:25305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c93 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.776903:0:25305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c93 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.776915:0:25305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c93 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.777151:0:25305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff704c9a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3450f5a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.777161:0:25305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff704c9a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3450f5a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.777180:0:25305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff704c9a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3450f5a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.777755:0:25305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c93 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.777766:0:25305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c93 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.777774:0:25305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c93 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.777780:0:25305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813458.777786:0:25305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c93 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.777794:0:25305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c93 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.777805:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948a6fe50300) 00010000:00010000:0.0:1788813458.777819:0:25305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813458.777825:0:25305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c93 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.777832:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff704c93 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.777847:0:25305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff704c9a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3450f5a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.777854:0:25305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff704c9a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3450f5a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.778227:0:25305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff704c9a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3450f5a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.778233:0:25305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dace00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813458.778237:0:25305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff704c9a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3450f5a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.778245:0:25305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff704c9a lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3450f5a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.778254:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x3450f5a1 (ffff948a455ee100) 00010000:00010000:0.0:1788813458.778256:0:25305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813458.778260:0:25305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff704c9a lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3450f5a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.778265:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff704c9a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3450f5a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813458.778419:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+39:18836:x1875706301817728:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 1723us (2128us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813458.778435:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 61 00000100:00100000:1.0:1788813458.782485:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813458.782669:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301817856 00000100:00100000:2.0:1788813458.782680:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301817856 00000100:00100000:2.0:1788813458.782741:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 62 00000100:00100000:2.0:1788813458.782752:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+39:18836:x1875706301817856:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813458.782774:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813458.782812:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb200/0xf32533d6ff704ca1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729e22 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.782847:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb600/0xf32533d6ff704ca8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.782873:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb600/0xf32533d6ff704ca8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.782885:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb600/0xf32533d6ff704ca8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.783291:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb200/0xf32533d6ff704ca1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e22 expref: 41 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.783310:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb600/0xf32533d6ff704ca8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e22 expref: 40 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.783318:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948942ffb800) 00010000:00010000:2.0:1788813458.783322:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788813458.783325:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a5e7eb600, rc 0) 00000100:00100000:2.0:1788813458.783426:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+40:18836:x1875706301817856:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 675us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813458.783434:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 62 00000100:00100000:0.0:1788813458.788664:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313442432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813458.788745:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813458.788863:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313442432 00000100:00100000:2.0:1788813458.788871:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313442432 00000100:00100000:2.0:1788813458.788978:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813458.788988:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313442432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788813458.789020:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788813458.789087:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313442432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813458.789095:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813458.789152:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313442432:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788813458.789286:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813458.796819:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813458.796868:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301818112 00000100:00100000:0.0:1788813458.796884:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301818112 00000100:00100000:0.0:1788813458.796974:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:0.0:1788813458.796985:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+40:18836:x1875706301818112:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788813458.797078:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8400/0xf32533d6ff704caf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.797096:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8400/0xf32533d6ff704caf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.797109:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8400/0xf32533d6ff704caf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813458.797312:0:22724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1788813458.797324:0:22724:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 611816391682ns, next at 612816387169ns, rc = 0 00000004:00010000:0.0:1788813458.797378:0:22724:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bef6cb34 reply state 00000000365bd541 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8400/0xf32533d6ff704caf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.797391:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8400/0xf32533d6ff704caf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.797399:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948942ffb800) 00010000:00010000:0.0:1788813458.797402:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788813458.797419:0:22724:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813458.797525:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+42:18836:x1875706301818112:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 540us (716us total) trans 12884901917 rc 0/0 00000100:00100000:0.0:1788813458.797534:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:1.0:1788813458.803429:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313442560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813458.803517:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813458.804520:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813458.804832:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301818240 00000100:00100000:3.0:1788813458.804840:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301818240 00000100:00100000:3.0:1788813458.804951:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 64 00000100:00100000:3.0:1788813458.804971:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+42:18836:x1875706301818240:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813458.804996:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813458.805017:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704cb6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729e29 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.805083:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704cb6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e29 expref: 43 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.805098:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704cb6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e29 expref: 43 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.805118:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948942ffb800) 00010000:00010000:3.0:1788813458.805150:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813458.805156:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08200, rc 0) 00000100:00100000:3.0:1788813458.805225:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+43:18836:x1875706301818240:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 265us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813458.805232:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 64 00000100:00100000:2.0:1788813458.808985:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313442560 00000100:00100000:2.0:1788813458.809002:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313442560 00000100:00100000:2.0:1788813458.809089:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813458.809100:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313442560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813458.809128:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788813458.809233:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313442560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (5716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813458.809241:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788813458.809434:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313442560:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788813458.809460:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813458.812849:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813458.813995:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301818368 00000100:00100000:2.0:1788813458.814011:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301818368 00000100:00100000:2.0:1788813458.814080:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:2.0:1788813458.814091:0:24230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2396:x1875706301818368:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788813458.814385:0:24230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+6:2396:x1875706301818368:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 Request processed in 276us (1527us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788813458.814393:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:3.0:1788813458.825029:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813458.825159:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301818624 00000100:00100000:1.0:1788813458.825181:0:22727:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301818624 00000100:00100000:1.0:1788813458.825250:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:1.0:1788813458.825261:0:22727:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+43:18836:x1875706301818624:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788813458.825511:0:22727:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+44:18836:x1875706301818624:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 252us (491us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1788813458.825533:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:1.0:1788813458.831995:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813458.832157:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301818880 00000100:00100000:0.0:1788813458.832180:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301818880 00000100:00100000:0.0:1788813458.832248:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:0.0:1788813458.832260:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+44:18836:x1875706301818880:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788813458.832389:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+44:18836:x1875706301818880:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 132us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813458.832398:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:0.0:1788813458.837820:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813458.838186:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301819008 00000100:00100000:3.0:1788813458.838197:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301819008 00000100:00100000:3.0:1788813458.838296:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 66 00000100:00100000:3.0:1788813458.838308:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+44:18836:x1875706301819008:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813458.838329:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813458.838348:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704cbd lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729e30 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.838429:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff704cc4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.838455:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff704cc4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.838467:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff704cc4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813458.838512:0:22725:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813458.838529:0:22725:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff704cc4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.838558:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704cbd lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e30 expref: 46 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.838595:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff704cc4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e30 expref: 45 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.838604:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948942ffb800) 00010000:00010000:3.0:1788813458.838606:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788813458.838610:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09c00, rc 0) 00000100:00100000:3.0:1788813458.838677:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+45:18836:x1875706301819008:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 372us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813458.838685:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 66 00000100:00100000:0.0:1788813458.843339:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813458.843431:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301819136 00000100:00100000:3.0:1788813458.843511:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301819136 00000100:00100000:3.0:1788813458.843605:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 26 00000100:00100000:3.0:1788813458.843617:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+6:2397:x1875706301819136:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813458.843638:0:24231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813458.843661:0:24231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5138bbe/0xf32533d6ff704ccb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729e37 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813458.843686:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f2093, blocks: 0x0 00010000:00010000:3.0:1788813458.843706:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=611s v=(0 0) 00010000:00010000:3.0:1788813458.843710:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813458.843719:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5138bbe/0xf32533d6ff704ccb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e37 expref: 7 pid: 24231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.843737:0:24231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5138bbe/0xf32533d6ff704ccb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e37 expref: 7 pid: 24231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.843767:0:24231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08400, rc 0) 00000100:00100000:3.0:1788813458.843833:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+7:2397:x1875706301819136:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 219us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813458.843840:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 26 00000100:00100000:0.0:1788813458.849687:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813458.850437:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301819392 00000100:00100000:2.0:1788813458.850524:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301819392 00000100:00100000:2.0:1788813458.850619:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:2.0:1788813458.850631:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+45:18836:x1875706301819392:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788813458.850786:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+45:18836:x1875706301819392:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 156us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813458.850794:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:1.0:1788813458.854922:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813458.855511:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301819520 00000100:00100000:3.0:1788813458.855523:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301819520 00000100:00100000:3.0:1788813458.855640:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 68 00000100:00100000:3.0:1788813458.855651:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+45:18836:x1875706301819520:12345-192.168.202.13@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788813458.869179:0:22703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:0.0:1788813458.869199:0:22703:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1788813458.869259:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869273:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a8d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869281:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869287:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813458.869292:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813458.869298:0:22703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:2.0:1788813458.869301:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a8d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869322:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff948a6fe50c00) 00010000:00010000:2.0:1788813458.869326:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813458.869332:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a8d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869338:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08600/0xf32533d6ff704a8d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.869420:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704ae1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.869431:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704ae1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.869437:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704ae1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.869450:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948941a81e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813458.869455:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704ae1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.869462:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704ae1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.869472:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948a6fe50300) 00010000:00010000:1.0:1788813458.869476:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788813458.869480:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704ae1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.869486:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948941a81e00/0xf32533d6ff704ae1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869540:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a94 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869549:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a94 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869554:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a94 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869576:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813458.869580:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a94 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869586:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a94 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869594:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948a6fe50300) 00010000:00010000:2.0:1788813458.869596:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813458.869600:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a94 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869605:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704a94 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869617:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff704b3c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869624:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff704b3c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869629:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff704b3c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869635:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813458.869638:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff704b3c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869644:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff704b3c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869661:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff948a6aed9000) 00010000:00010000:2.0:1788813458.869664:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813458.869667:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff704b3c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869674:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda600/0xf32533d6ff704b3c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869690:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704bc1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869696:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704bc1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869702:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704bc1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869708:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813458.869710:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704bc1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869715:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704bc1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869723:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:2.0:1788813458.869725:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813458.869727:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704bc1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869733:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff704bc1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869754:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704be4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869761:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704be4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869767:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704be4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869772:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813458.869775:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704be4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869781:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704be4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869788:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:2.0:1788813458.869791:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813458.869794:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704be4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869799:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704be4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869808:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704c2a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869813:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704c2a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869818:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704c2a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869829:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813458.869832:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704c2a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869837:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704c2a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869846:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:2.0:1788813458.869847:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813458.869850:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704c2a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.869855:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704c2a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813458.871264:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+16:18836:x1875706301819520:12345-192.168.202.13@tcp:44:lhsmtool_posix.0 Request processed in 15608us (16347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813458.871276:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 68 00000100:00100000:0.0:1788813458.873154:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313442688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788813458.873233:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813458.873510:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8400/0xf32533d6ff704caf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.873520:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8400/0xf32533d6ff704caf lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.873529:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8400/0xf32533d6ff704caf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.873535:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813458.873540:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8400/0xf32533d6ff704caf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.873547:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8400/0xf32533d6ff704caf lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.873581:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948942ffb800) 00010000:00010000:2.0:1788813458.873584:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788813458.873591:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8400/0xf32533d6ff704caf lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.873596:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8400/0xf32533d6ff704caf lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813458.874138:0:25304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313442688 00000100:00100000:3.0:1788813458.874149:0:25304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313442688 00000100:00100000:3.0:1788813458.874221:0:25304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788813458.874232:0:25304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313442688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788813458.874401:0:25304:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788813458.874404:0:25304:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788813458.874406:0:25304:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788813458.874408:0:25304:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788813459 -> 1788813459 00002000:00010000:3.0:1788813458.874411:0:25304:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788813458.874489:0:25304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3625:x1875706313442688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 258us (1254us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788813458.874496:0:25304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:1.0:1788813458.874573:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948944027b80/2, rc 0, transno 12884901892 00000100:00100000:1.0:1788813458.874580:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313442688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788813458.875922:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813458.876091:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301819648 00000100:00100000:2.0:1788813458.876100:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301819648 00000100:00100000:2.0:1788813458.876157:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:2.0:1788813458.876181:0:24230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+7:2396:x1875706301819648:12345-192.168.202.13@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788813458.876291:0:24230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+7:2396:x1875706301819648:12345-192.168.202.13@tcp:16:lhsmtool_posix.0 Request processed in 125us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813458.876298:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:3.0:1788813458.880999:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813458.881105:0:25305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301819904 00000100:00100000:1.0:1788813458.881139:0:25305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301819904 00000100:00100000:1.0:1788813458.881211:0:25305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 69 00000100:00100000:1.0:1788813458.881222:0:25305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+14:18836:x1875706301819904:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788813458.881279:0:25305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813458.881306:0:25305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff704cc4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e30 expref: 14 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.881340:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948942ffb800) 00010000:00010000:1.0:1788813458.881346:0:25305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813458.881378:0:25305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff704cd2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.881403:0:25305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff704cd2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.881424:0:25305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff704cd2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813458.881731:0:25305:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2121d33 reply state 00000000dc514242 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff704cd2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.881745:0:25305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff704cd2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.881752:0:25305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948942ffb800) 00010000:00010000:1.0:1788813458.881754:0:25305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788813458.881756:0:25305:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788813458.881849:0:25305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+15:18836:x1875706301819904:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 627us (859us total) trans 12884901919 rc 0/0 00000100:00100000:1.0:1788813458.881857:0:25305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 69 00000100:00100000:1.0:1788813458.893600:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813458.893684:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301820032 00000100:00100000:3.0:1788813458.893695:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301820032 00000100:00100000:3.0:1788813458.893760:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00100000:3.0:1788813458.893771:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+7:18836:x1875706301820032:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813458.893791:0:24231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813458.893812:0:24231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081fcfc96/0xf32533d6ff704cd9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729e3e expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.893846:0:24231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5138bbe/0xf32533d6ff704ccb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e37 expref: 8 pid: 24231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.893855:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813458.893860:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813458.893866:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081fcfc96/0xf32533d6ff704cd9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e3e expref: 8 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.893903:0:24231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5138bbe/0xf32533d6ff704ccb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e37 expref: 8 pid: 24231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.893918:0:24231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5138bbe/0xf32533d6ff704ccb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e37 expref: 8 pid: 24231 timeout: 711 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813458.893977:0:24231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24231:1875706313442816:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813458.894056:0:24231:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813458.902904:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813458.902992:0:24231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24231:1875706313442816:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813458.903067:0:24231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081fcfc96/0xf32533d6ff704cd9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e3e expref: 8 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.903091:0:24231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09600, rc 0) 00000100:00100000:1.0:1788813458.903095:0:25754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301820160 00000100:00100000:1.0:1788813458.903106:0:25754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301820160 00000100:00100000:0.0:1788813458.903152:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+9:18836:x1875706301820032:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 9383us (9562us total) trans 0 rc 0/0 00010000:00010000:1.0:1788813458.903177:0:25754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5138bbe/0xf32533d6ff704ccb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e37 expref: 9 pid: 24231 timeout: 711 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813458.903181:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00100000:1.0:1788813458.903229:0:25754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:1.0:1788813458.903241:0:25754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+8:2396:x1875706301820160:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813458.903258:0:25754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813458.903286:0:25754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5138bbe/0xf32533d6ff704ccb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e37 expref: 8 pid: 24231 timeout: 711 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.903302:0:25754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5138bbe/0xf32533d6ff704ccb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e37 expref: 8 pid: 24231 timeout: 711 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.903329:0:25754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5138bbe/0xf32533d6ff704ccb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e37 expref: 8 pid: 24231 timeout: 711 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.903345:0:25754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813458.903350:0:25754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813458.903358:0:25754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081fcfc96/0xf32533d6ff704cd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e3e expref: 7 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.903368:0:25754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081fcfc96/0xf32533d6ff704cd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e3e expref: 7 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813458.903430:0:25754:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000081fcfc96/0xf32533d6ff704cd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e3e expref: 7 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813458.903445:0:25754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6103b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:25754:1875706313442944:192.168.202.13@tcp:105: 00000100:00100000:1.0:1788813458.903507:0:25754:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ec02180 going to sleep for 11 seconds 00000100:00100000:1.0:1788813458.911023:0:25754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6103b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:25754:1875706313442944:192.168.202.13@tcp:105: 00010000:00010000:1.0:1788813458.911054:0:25754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813458.911202:0:25754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7492b028-cad1-4968-b6ea-0072cb2dae48+7:2396:x1875706301820160:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 7963us (8309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813458.911214:0:25754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:3.0:1788813458.920749:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813458.920996:0:25304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301820288 00000100:00100000:0.0:1788813458.921006:0:25304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301820288 00000100:00100000:0.0:1788813458.921065:0:25304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:0.0:1788813458.921074:0:25304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7492b028-cad1-4968-b6ea-0072cb2dae48+7:2397:x1875706301820288:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788813458.921229:0:25304:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788813458.921233:0:25304:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788813458 00002000:00010000:0.0:1788813458.921235:0:25304:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788813457 00002000:00010000:0.0:1788813458.921237:0:25304:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788813459 -> 1788813458 00002000:00010000:0.0:1788813458.921240:0:25304:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788813458.921307:0:25304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7492b028-cad1-4968-b6ea-0072cb2dae48+8:2397:x1875706301820288:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 Request processed in 234us (570us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788813458.921315:0:25304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:0.0:1788813458.925296:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813458.925531:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301820416 00000100:00100000:2.0:1788813458.925543:0:24230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301820416 00000100:00100000:2.0:1788813458.925606:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:2.0:1788813458.925616:0:24230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+8:2399:x1875706301820416:12345-192.168.202.13@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788813458.925659:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000045b9078f/0xf32533d6ff704ce0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.926078:0:24230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081fcfc96/0xf32533d6ff704cd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e3e expref: 8 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.926088:0:24230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813458.926107:0:24230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813458.926111:0:24230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045b9078f/0xf32533d6ff704ce0 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.926151:0:24230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081fcfc96/0xf32533d6ff704cd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e3e expref: 8 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.926180:0:24230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081fcfc96/0xf32533d6ff704cd9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e3e expref: 8 pid: 24231 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813458.926196:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24230:1875706313443072:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813458.926280:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813458.929342:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24230:1875706313443072:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813458.929371:0:24230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000045b9078f/0xf32533d6ff704ce0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813458.937113:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813458.937586:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301820544 00000100:00100000:2.0:1788813458.937597:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301820544 00010000:00010000:2.0:1788813458.937636:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081fcfc96/0xf32533d6ff704cd9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e3e expref: 9 pid: 24231 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813458.937675:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:2.0:1788813458.937684:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+9:2398:x1875706301820544:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813458.937699:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813458.937720:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081fcfc96/0xf32533d6ff704cd9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e3e expref: 9 pid: 24231 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.937745:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081fcfc96/0xf32533d6ff704cd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e3e expref: 9 pid: 24231 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.937766:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081fcfc96/0xf32533d6ff704cd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e3e expref: 9 pid: 24231 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.937782:0:22709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813458.937787:0:22709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813458.937792:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045b9078f/0xf32533d6ff704ce0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.937801:0:22709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045b9078f/0xf32533d6ff704ce0 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.937831:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813458.937879:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+8:2398:x1875706301820544:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 197us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813458.937887:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 21 00010000:00010000:0.0:1788813458.937987:0:24230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000045b9078f/0xf32533d6ff704ce0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.937996:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045b9078f/0xf32533d6ff704ce0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.938015:0:24230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000045b9078f/0xf32533d6ff704ce0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.938023:0:24230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045b9078f/0xf32533d6ff704ce0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.938038:0:24230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045b9078f/0xf32533d6ff704ce0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.938045:0:24230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a5e7eba00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813458.938050:0:24230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045b9078f/0xf32533d6ff704ce0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.938058:0:24230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045b9078f/0xf32533d6ff704ce0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.938070:0:24230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045b9078f/0xf32533d6ff704ce0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.938077:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045b9078f/0xf32533d6ff704ce0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813458.938117:0:24230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+7:2399:x1875706301820416:12345-192.168.202.13@tcp:1:lhsmtool_posix.0 Request processed in 12504us (12832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813458.938124:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:1.0:1788813458.965396:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813458.965517:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301820800 00000100:00100000:2.0:1788813458.965527:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301820800 00000100:00100000:2.0:1788813458.965595:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 70 00000100:00100000:2.0:1788813458.965606:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6103b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+15:18836:x1875706301820800:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788813458.965690:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704ce7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.965728:0:22725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff704bba lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ddc expref: 15 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.965738:0:22725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704ce7 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.965771:0:22725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff704bba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ddc expref: 15 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.965785:0:22725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff704bba lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ddc expref: 15 pid: 22725 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813458.965799:0:22725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22725:1875706313443200:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813458.965870:0:22725:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813458.971016:0:22725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22725:1875706313443200:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813458.971048:0:22725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704ce7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813458.975891:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813458.976044:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301820928 00000100:00100000:3.0:1788813458.976055:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301820928 00010000:00010000:3.0:1788813458.976096:0:22710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff704bba lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ddc expref: 16 pid: 22725 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813458.976147:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:3.0:1788813458.976157:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6103a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+16:2397:x1875706301820928:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813458.976184:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813458.976192:0:22710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff704bba lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ddc expref: 16 pid: 22725 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.976206:0:22710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff704bba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ddc expref: 16 pid: 22725 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.976229:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff704bba lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ddc expref: 16 pid: 22725 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.976247:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:3.0:1788813458.976252:0:22710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c4d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e0d expref: 15 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.976263:0:22710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704ce7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.976270:0:22710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704ce7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.976278:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704ce7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813458.976337:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813458.976671:0:22725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704ce7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.976681:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704ce7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.976894:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eae00/0xf32533d6ff704cee lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.976908:0:22725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704cb6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e29 expref: 16 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.976921:0:22725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eae00/0xf32533d6ff704cee lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.976986:0:22725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704cb6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e29 expref: 16 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.976999:0:22725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704cb6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e29 expref: 16 pid: 22725 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813458.977012:0:22725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22725:1875706313443328:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813458.977091:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6103a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+16:2397:x1875706301820928:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 934us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813458.977099:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:2.0:1788813458.980703:0:22725:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082540 going to sleep for 11 seconds 00000100:00100000:3.0:1788813458.993575:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813458.995256:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301821056 00000100:00100000:0.0:1788813458.995268:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301821056 00010000:00010000:0.0:1788813458.995316:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704cb6 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e29 expref: 16 pid: 22725 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813458.995367:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:0.0:1788813458.995397:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a74bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+16:2396:x1875706301821056:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813458.995412:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813458.995419:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704cb6 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e29 expref: 16 pid: 22725 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.995433:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704cb6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e29 expref: 16 pid: 22725 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.995456:0:22709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948942ffb800) 00010000:00010000:0.0:1788813458.995462:0:22709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eae00/0xf32533d6ff704cee lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.995472:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eae00/0xf32533d6ff704cee lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.995479:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eae00/0xf32533d6ff704cee lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813458.995499:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813458.995564:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a74bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+16:2396:x1875706301821056:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 169us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813458.995572:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 23 00010000:00010000:2.0:1788813458.997545:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff704cb6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e29 expref: 15 pid: 22725 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813458.997568:0:22725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22725:1875706313443328:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813458.997591:0:22725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eae00/0xf32533d6ff704cee lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.997602:0:22725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eae00/0xf32533d6ff704cee lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813458.997608:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eae00/0xf32533d6ff704cee lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813458.997721:0:22725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1788813458.998718:0:22725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1788813458.998762:0:22725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1788813458.998861:0:22725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22725:1875706313443456:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788813458.998927:0:22725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813458.998979:0:22725:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489410829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813458.999047:0:23758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313443456 00000100:00100000:3.0:1788813458.999054:0:23758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313443456 00000100:00100000:3.0:1788813458.999106:0:23758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788813458.999115:0:23758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22725:x1875706313443456:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788813458.999220:0:23758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22725:x1875706313443456:12345-0@lo:1000:mdt00_002.0 Request processed in 106us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813458.999231:0:23758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788813459.004867:0:22725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22725:1875706313443456:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788813459.005119:0:22725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:2.0:1788813459.005259:0:22725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22725:1875706313443584:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788813459.005323:0:22725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813459.005348:0:22725:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082300 going to sleep for 11 seconds 00000100:00100000:0.0:1788813459.005515:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313443584 00000100:00100000:0.0:1788813459.005523:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313443584 00000100:00100000:0.0:1788813459.005571:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788813459.005580:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22725:x1875706313443584:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788813459.005706:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22725:x1875706313443584:12345-0@lo:1000:mdt00_002.0 Request processed in 127us (382us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788813459.005723:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788813459.005980:0:22725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22725:1875706313443584:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788813459.006019:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eae00/0xf32533d6ff704cee lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.006030:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eae00/0xf32533d6ff704cee lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.006037:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eae00/0xf32533d6ff704cee lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.006043:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a5e7eae00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813459.006048:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eae00/0xf32533d6ff704cee lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.006056:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eae00/0xf32533d6ff704cee lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.006071:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948942ffb800) 00010000:00010000:2.0:1788813459.006074:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813459.006079:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eae00/0xf32533d6ff704cee lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.006095:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eae00/0xf32533d6ff704cee lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.006137:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704c46 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.006143:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704c46 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.006150:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704c46 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.006154:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813459.006157:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704c46 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.006171:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704c46 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.006180:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:2.0:1788813459.006182:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813459.006188:0:22725:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c4d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e0d expref: 18 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.006202:0:22725:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c4d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e0d expref: 18 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.006211:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c4d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e0d expref: 18 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.006273:0:22725:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704c4d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e0d expref: 18 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813459.006284:0:22725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22725:1875706313443712:192.168.202.13@tcp:105: 00000100:00100000:2.0:1788813459.006349:0:22725:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082300 going to sleep for 11 seconds 00000100:00100000:3.0:1788813459.013545:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813459.013690:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301821184 00000100:00100000:1.0:1788813459.013701:0:22727:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301821184 00000100:00100000:1.0:1788813459.013777:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12 00000100:00100000:1.0:1788813459.013790:0:22727:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+19:18835:x1875706301821184:12345-192.168.202.13@tcp:49:bash.0 00000100:00100000:1.0:1788813459.013921:0:22727:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+19:18835:x1875706301821184:12345-192.168.202.13@tcp:49:bash.0 Request processed in 134us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813459.013928:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12 00000100:00100000:2.0:1788813459.014567:0:22725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22725:1875706313443712:192.168.202.13@tcp:105: 00010000:00010000:2.0:1788813459.014593:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704c46 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014603:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8200/0xf32533d6ff704c46 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 25305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014634:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea000/0xf32533d6ff704cf5 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014648:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea000/0xf32533d6ff704cf5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014659:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea000/0xf32533d6ff704cf5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014670:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea000/0xf32533d6ff704cf5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014677:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea000/0xf32533d6ff704cf5 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014684:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea000/0xf32533d6ff704cf5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014707:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a5e7ea000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813459.014711:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea000/0xf32533d6ff704cf5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014719:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea000/0xf32533d6ff704cf5 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014732:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:2.0:1788813459.014735:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813459.014739:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea000/0xf32533d6ff704cf5 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014745:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea000/0xf32533d6ff704cf5 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014755:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704ce7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014761:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704ce7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014768:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704ce7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014773:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a5e7eac00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813459.014776:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704ce7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014782:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704ce7 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014801:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:2.0:1788813459.014804:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788813459.014807:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704ce7 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.014813:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704ce7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813459.014967:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6103b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+18:18836:x1875706301820800:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 49363us (49582us total) trans 12884901924 rc 0/0 00000100:00100000:2.0:1788813459.014976:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 70 00000020:00080000:2.0:1788813459.014980:0:22725:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00080000:0.0:1788813459.015548:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788813459.015703:0:22759:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788813459.015708:0:22759:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813459.015726:0:22759:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788813459.015731:0:22759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788813459.024608:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813459.026233:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301821312 00000100:00100000:0.0:1788813459.026249:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301821312 00000100:00100000:3.0:1788813459.026724:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813459.026818:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301821568 00000100:00100000:2.0:1788813459.026824:0:22727:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301821568 00000100:00100000:2.0:1788813459.026883:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:2.0:1788813459.026894:0:22727:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+18:18836:x1875706301821568:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788813459.027229:0:22727:0:(mdd_object.c:4199:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788813459.027261:0:22727:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:2.0:1788813459.027295:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704cfc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.027312:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704cfc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.027325:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704cfc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.027349:0:22727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704cfc lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.027375:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704cfc lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.027391:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704cfc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.027406:0:22727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788813459.027496:0:22727:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+20:18836:x1875706301821568:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 604us (777us total) trans 12884901926 rc 0/0 00000100:00100000:2.0:1788813459.027504:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13 00000020:00080000:2.0:1788813459.027509:0:22727:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788813459.027799:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813459.027807:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704cfc lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813459.027814:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a5e7eac00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813459.027818:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704cfc lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813459.027825:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704cfc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813459.027837:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948942ffb800) 00010000:00010000:0.0:1788813459.027841:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788813459.027846:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704cfc lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813459.027852:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eac00/0xf32533d6ff704cfc lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813459.027864:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813459.027865:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813459.027867:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813459.029279:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 32 00000100:00100000:1.0:1788813459.029309:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+7:18835:x1875706301821312:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:1.0:1788813459.029340:0:24231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813459.029363:0:24231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f8439de/0xf32533d6ff704d03 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729e45 expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813459.029398:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9f2092, atime: 0x6a9f2091, ctime: 0x6a9f2092, blocks: 0x0 00010000:00010000:1.0:1788813459.029421:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788813459.029427:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813459.029436:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f8439de/0xf32533d6ff704d03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e45 expref: 8 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813459.029452:0:24231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f8439de/0xf32533d6ff704d03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e45 expref: 8 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813459.029464:0:24231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac200, rc 0) 00000100:00100000:1.0:1788813459.029531:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+8:18835:x1875706301821312:12345-192.168.202.13@tcp:101:bash.0 Request processed in 228us (4934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813459.029539:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 32 00000100:00080000:0.0:1788813459.033085:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813459.035210:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813459.035309:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301821696 00000100:00100000:2.0:1788813459.035319:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301821696 00000100:00100000:2.0:1788813459.035395:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 71 00000100:00100000:2.0:1788813459.035405:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+20:18835:x1875706301821696:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:2.0:1788813459.035431:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813459.035453:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eaa00/0xf32533d6ff704d0a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729e4c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.035487:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ebe00/0xf32533d6ff704d11 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.035501:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ebe00/0xf32533d6ff704d11 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.035512:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ebe00/0xf32533d6ff704d11 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.035627:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eaa00/0xf32533d6ff704d0a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e4c expref: 22 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.035652:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ebe00/0xf32533d6ff704d11 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e4c expref: 21 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.035660:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:2.0:1788813459.035663:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788813459.035667:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a5e7ebe00, rc 0) 00000100:00100000:2.0:1788813459.035729:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+21:18835:x1875706301821696:12345-192.168.202.13@tcp:101:bash.0 Request processed in 326us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813459.035736:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 71 00000100:00100000:2.0:1788813459.039083:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813459.039224:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301821952 00000100:00100000:1.0:1788813459.039235:0:22727:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301821952 00000100:00100000:1.0:1788813459.039358:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00100000:1.0:1788813459.039370:0:22727:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+21:18835:x1875706301821952:12345-192.168.202.13@tcp:35:bash.0 00000001:00080000:1.0:1788813459.039588:0:22727:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:1.0:1788813459.039664:0:22727:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:1.0:1788813459.039773:0:22727:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+24:18835:x1875706301821952:12345-192.168.202.13@tcp:35:bash.0 Request processed in 405us (699us total) trans 12884901929 rc 0/0 00000100:00100000:1.0:1788813459.039792:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 14 00000020:00080000:1.0:1788813459.039798:0:22727:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788813459.237154:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813459.241088:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301822208 00000100:00100000:0.0:1788813459.241107:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301822208 00000100:00100000:0.0:1788813459.241905:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:0.0:1788813459.241919:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+24:18846:x1875706301822208:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813459.241987:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813459.242010:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff704d18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729e53 expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813459.242117:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788813459.243504:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff704d18 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e53 expref: 26 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813459.243525:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948942ffbc00) 00010000:00010000:0.0:1788813459.243529:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788813459.243535:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff704d18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729e53 expref: 26 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813459.243552:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9c00, rc 0) 00000100:00100000:0.0:1788813459.243692:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+25:18846:x1875706301822208:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 1775us (6559us total) trans 12884901930 rc 301/301 00000100:00100000:0.0:1788813459.243701:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:0.0:1788813459.258756:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813459.259063:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301822336 00000100:00100000:2.0:1788813459.259074:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301822336 00000100:00100000:2.0:1788813459.259145:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 73 00000100:00100000:2.0:1788813459.259158:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+25:18846:x1875706301822336:12345-192.168.202.13@tcp:34:lfs.0 00010000:00010000:2.0:1788813459.259249:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea200/0xf32533d6ff704d26 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259268:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea200/0xf32533d6ff704d26 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259283:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea200/0xf32533d6ff704d26 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259300:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704d2d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259308:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704d2d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259330:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704d2d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259582:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb000/0xf32533d6ff704d34 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259591:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb000/0xf32533d6ff704d34 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259598:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb000/0xf32533d6ff704d34 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813459.259643:0:22724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb000/0xf32533d6ff704d34 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259655:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea200/0xf32533d6ff704d26 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259661:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea200/0xf32533d6ff704d26 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259669:0:22724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea200/0xf32533d6ff704d26 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259674:0:22724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a5e7ea200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813459.259678:0:22724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea200/0xf32533d6ff704d26 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259686:0:22724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea200/0xf32533d6ff704d26 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259698:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948a6fe50300) 00010000:00010000:2.0:1788813459.259707:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813459.259713:0:22724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea200/0xf32533d6ff704d26 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259720:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea200/0xf32533d6ff704d26 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259734:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704d2d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259740:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704d2d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259746:0:22724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704d2d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259751:0:22724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a5e7ea600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813459.259754:0:22724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704d2d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259760:0:22724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704d2d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259767:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff948942ffb600) 00010000:00010000:2.0:1788813459.259770:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813459.259773:0:22724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704d2d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259778:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7ea600/0xf32533d6ff704d2d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259792:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb000/0xf32533d6ff704d34 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259805:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb000/0xf32533d6ff704d34 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259811:0:22724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb000/0xf32533d6ff704d34 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259815:0:22724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a5e7eb000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813459.259818:0:22724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb000/0xf32533d6ff704d34 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259823:0:22724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb000/0xf32533d6ff704d34 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259831:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948a6aed9400) 00010000:00010000:2.0:1788813459.259833:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813459.259836:0:22724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb000/0xf32533d6ff704d34 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813459.259841:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a5e7eb000/0xf32533d6ff704d34 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813459.260355:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492b028-cad1-4968-b6ea-0072cb2dae48+25:18846:x1875706301822336:12345-192.168.202.13@tcp:34:lfs.0 Request processed in 1196us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813459.260372:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 73 00000100:00100000:2.0:1788813459.263553:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813459.267483:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301822592 00000100:00100000:3.0:1788813459.267502:0:22726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301822592 00000100:00100000:3.0:1788813459.267592:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:3.0:1788813459.267603:0:22726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+25:18846:x1875706301822592:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:3.0:1788813459.267883:0:22726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+26:18846:x1875706301822592:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 281us (4340us total) trans 12884901931 rc 0/0 00000100:00100000:3.0:1788813459.267892:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15 00010000:00010000:2.0:1788813459.365215:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813459.812261:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813459.812289:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6103b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313443840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813459.812372:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813459.812640:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313443840 00000100:00100000:1.0:1788813459.812648:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313443840 00000100:00100000:1.0:1788813459.812712:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788813459.812724:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313443840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813459.812757:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788813459.812808:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313443840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813459.812815:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788813459.812845:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313444096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813459.812900:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813459.812955:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813459.812962:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313443968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813459.812984:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813459.813006:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313443968 00000100:00100000:1.0:1788813459.813011:0:24232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313443968 00000100:00100000:1.0:1788813459.813029:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813459.813035:0:24232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6103b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313443968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788813459.813044:0:24232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788813459.813073:0:24232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6103b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313443968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813459.813078:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813459.813114:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313443968:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788813459.813183:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813459.813278:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313444608:0@lo:400:kworker.0 00000100:00100000:3.0:1788813459.813315:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813459.813334:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313445120:0@lo:400:kworker.0 00000100:00100000:3.0:1788813459.813361:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813459.813377:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788813459.813382:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313444480:0@lo:400:kworker.0 00000100:00100000:3.0:1788813459.813403:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813459.813417:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313444992:0@lo:400:kworker.0 00000100:00100000:3.0:1788813459.813446:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813459.813471:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313444608 00000100:00100000:3.0:1788813459.813475:0:24228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313444608 00000100:00100000:3.0:1788813459.813506:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788813459.813512:0:24228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313444608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813459.813548:0:24228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313444608:12345-0@lo:400:kworker.0 Request processed in 37us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813459.813553:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788813459.813597:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313444608:0@lo:400:kworker.0 00000100:00100000:2.0:1788813459.813748:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313444096 00000100:00100000:2.0:1788813459.813753:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313444096 00000100:00100000:2.0:1788813459.813791:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313444480 00000100:00100000:2.0:1788813459.813794:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313444480 00000100:00100000:2.0:1788813459.813821:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788813459.813827:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313444096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813459.813853:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788813459.813894:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313444096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813459.813900:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788813459.813913:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788813459.813920:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313444480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813459.813971:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313444480:12345-0@lo:400:kworker.0 Request processed in 52us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813459.813978:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788813459.813998:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313445120 00000100:00100000:2.0:1788813459.814001:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313445120 00000100:00100000:2.0:1788813459.814038:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313444992 00000100:00100000:2.0:1788813459.814041:0:22724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313444992 00000100:00100000:2.0:1788813459.814067:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788813459.814074:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313445120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813459.814105:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313445120:12345-0@lo:400:kworker.0 Request processed in 32us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813459.814111:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788813459.814125:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788813459.814131:0:22724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313444992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813459.814166:0:22724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313444992:12345-0@lo:400:kworker.0 Request processed in 27us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813459.814172:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788813459.814292:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:151fd599-5695-4163-8caa-7faa559323aa:3625:1875706313444224:0@lo:400:kworker.0 00000100:00100000:0.0:1788813459.814327:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813459.814364:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313444736:0@lo:400:kworker.0 00000100:00100000:0.0:1788813459.814388:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813459.814405:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313445248:0@lo:400:kworker.0 00000100:00100000:0.0:1788813459.814456:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813459.814494:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6103b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313443840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813459.814508:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788813459.814514:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313444352:0@lo:400:kworker.0 00000100:00100000:0.0:1788813459.814536:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813459.814552:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313444864:0@lo:400:kworker.0 00000100:00100000:0.0:1788813459.814568:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813459.814579:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eda7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313445376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813459.814594:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813459.814615:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313444736 00000100:00100000:0.0:1788813459.814619:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313444736 00000100:00100000:0.0:1788813459.814637:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313445248 00000100:00100000:0.0:1788813459.814640:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313445248 00000100:00100000:0.0:1788813459.814654:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313444352 00000100:00100000:0.0:1788813459.814656:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313444352 00000100:00100000:0.0:1788813459.814666:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313444864 00000100:00100000:0.0:1788813459.814668:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313444864 00000100:00100000:0.0:1788813459.814680:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788813459.814685:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313444736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813459.814718:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313444736:12345-0@lo:400:kworker.0 Request processed in 33us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813459.814725:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788813459.814737:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788813459.814743:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313445248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813459.814767:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313445248:12345-0@lo:400:kworker.0 Request processed in 25us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813459.814772:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788813459.814792:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788813459.814797:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313444352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813459.814826:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313444352:12345-0@lo:400:kworker.0 Request processed in 29us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813459.814832:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788813459.814843:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788813459.814848:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313444864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813459.814873:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313444864:12345-0@lo:400:kworker.0 Request processed in 25us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813459.814878:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788813459.814902:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313444352:0@lo:400:kworker.0 00000100:00100000:0.0:1788813459.814911:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313444864:0@lo:400:kworker.0 00000100:00100000:0.0:1788813459.814919:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313444736:0@lo:400:kworker.0 00010000:00080000:0.0:1788813459.814974:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948944171880 x1875706313445248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813459.814986:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313445248:0@lo:400:kworker.0 00000100:00100000:2.0:1788813459.815246:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313444224 00000100:00100000:2.0:1788813459.815250:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313444224 00000100:00100000:2.0:1788813459.815294:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788813459.815302:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+24:3625:x1875706313444224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813459.815345:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:151fd599-5695-4163-8caa-7faa559323aa+24:3625:x1875706313444224:12345-0@lo:400:kworker.0 Request processed in 45us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813459.815351:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788813459.815391:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313445376 00000100:00100000:2.0:1788813459.815395:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313445376 00000100:00100000:2.0:1788813459.815417:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788813459.815423:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313445376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788813459.815444:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788813459.815475:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313445376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813459.815481:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788813459.815594:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813459.815599:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813459.815636:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313444480:0@lo:400:kworker.0 00010000:00080000:3.0:1788813459.815649:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948944173b80 x1875706313444992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813459.815658:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313444992:0@lo:400:kworker.0 00000100:00100000:3.0:1788813459.815669:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313445120:0@lo:400:kworker.0 00000100:00100000:3.0:1788813459.815682:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313444096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813459.824332:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eda7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313445376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813459.824350:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:151fd599-5695-4163-8caa-7faa559323aa:3625:1875706313444224:0@lo:400:kworker.0 00010000:00010000:3.0:1788813460.389612:0:23478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813460.583321:0:23477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788813461.412245:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788813461.484730:0:25808:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1788813462.400685:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813462.400733:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813462.400765:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813462.400781:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813462.400810:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813462.400828:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813462.400846:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813462.400866:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813462.400899:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813462.400926:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301823104 00000100:00100000:3.0:1788813462.400960:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301823104 00000100:00100000:3.0:1788813462.401030:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301823616 00000100:00100000:3.0:1788813462.401033:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301823616 00000100:00100000:3.0:1788813462.401046:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301823232 00000100:00100000:3.0:1788813462.401048:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301823232 00000100:00100000:3.0:1788813462.401057:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301823744 00000100:00100000:3.0:1788813462.401059:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301823744 00000100:00100000:3.0:1788813462.401072:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:3.0:1788813462.401081:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+8:2398:x1875706301823104:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813462.401165:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+8:2398:x1875706301823104:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 84us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813462.401174:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:3.0:1788813462.401193:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00100000:3.0:1788813462.401198:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2398:x1875706301823616:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813462.401224:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2398:x1875706301823616:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813462.401247:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00100000:3.0:1788813462.401271:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:3.0:1788813462.401278:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2398:x1875706301823232:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813462.401303:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2398:x1875706301823232:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813462.401309:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:3.0:1788813462.401322:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:3.0:1788813462.401327:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2398:x1875706301823744:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813462.401347:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2398:x1875706301823744:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 20us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813462.401352:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:3.0:1788813462.401595:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301822720 00000100:00100000:3.0:1788813462.401599:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301822720 00000100:00100000:3.0:1788813462.401627:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 171 00000100:00100000:3.0:1788813462.401633:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+13:2398:x1875706301822720:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813462.401670:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30ad7580-cbca-4182-959d-28f6755d6280+13:2398:x1875706301822720:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 38us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813462.401677:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 171 00000100:00080000:3.0:1788813462.401708:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813462.401712:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813462.402474:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301822848 00000100:00100000:0.0:1788813462.402481:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301822848 00000100:00100000:0.0:1788813462.402529:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301823360 00000100:00100000:0.0:1788813462.402532:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301823360 00000100:00100000:0.0:1788813462.402545:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301822976 00000100:00100000:0.0:1788813462.402547:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301822976 00000100:00100000:0.0:1788813462.402560:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301823488 00000100:00100000:0.0:1788813462.402562:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301823488 00000100:00100000:0.0:1788813462.402577:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 74 00000100:00100000:0.0:1788813462.402584:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+26:2398:x1875706301822848:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813462.402633:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+26:2398:x1875706301822848:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 50us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813462.402639:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 74 00000100:00100000:0.0:1788813462.402654:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 75 00000100:00100000:0.0:1788813462.402660:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:2398:x1875706301823360:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813462.402681:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+6:2398:x1875706301823360:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 23us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813462.402686:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 75 00000100:00100000:0.0:1788813462.402697:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 76 00000100:00100000:0.0:1788813462.402703:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2398:x1875706301822976:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813462.402725:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+5:2398:x1875706301822976:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 23us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813462.402731:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 76 00000100:00100000:0.0:1788813462.402743:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 77 00000100:00100000:0.0:1788813462.402749:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2398:x1875706301823488:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813462.402771:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f9ee3c2-14b6-4a7b-b263-f7a09903dc59+5:2398:x1875706301823488:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 23us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813462.402785:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 77 00000100:00080000:1.0:1788813462.403069:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788813462.403079:0:22719:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813462.404382:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813462.404418:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813462.404443:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301824000 00000100:00100000:0.0:1788813462.404449:0:24231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301824000 00000100:00100000:0.0:1788813462.404488:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 33 00000100:00100000:0.0:1788813462.404495:0:24231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+8:2397:x1875706301824000:12345-192.168.202.13@tcp:16:kworker.0 00000100:00100000:0.0:1788813462.404589:0:24231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7492b028-cad1-4968-b6ea-0072cb2dae48+8:2397:x1875706301824000:12345-192.168.202.13@tcp:16:kworker.0 Request processed in 95us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813462.404596:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 33 00000100:00100000:2.0:1788813462.404966:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301823872 00000100:00100000:2.0:1788813462.404972:0:24234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301823872 00002000:00100000:2.0:1788813462.405000:0:24234:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff948a7d76fb80 x1875706301823872/t0(0) o4->7492b028-cad1-4968-b6ea-0072cb2dae48@192.168.202.13@tcp:278/0 lens 504/0 e 0 to 0 dl 1788813473 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788813462.405011:0:24234:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948a7d76fb80 with x1875706301823872 ext(0->8) 00002000:00010000:2.0:1788813462.405029:0:24234:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff948a7d76fb80 00000100:00100000:2.0:1788813462.405051:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:2.0:1788813462.405059:0:24234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7d76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+8:2397:x1875706301823872:12345-192.168.202.13@tcp:4:bash.0 00000100:00100000:2.0:1788813462.407620:0:24234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7d76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7492b028-cad1-4968-b6ea-0072cb2dae48+10:2397:x1875706301823872:12345-192.168.202.13@tcp:4:bash.0 Request processed in 2550us (3232us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788813462.407634:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 0 00002000:00100000:2.0:1788813462.407647:0:24234:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff948a7d76fb80 x1875706301823872/t12884901895(0) o4->7492b028-cad1-4968-b6ea-0072cb2dae48@192.168.202.13@tcp:278/0 lens 504/448 e 0 to 0 dl 1788813473 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788813462.407670:0:24234:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948a7d76fb80 with x1875706301823872 ext(0->8) 00002000:00010000:2.0:1788813462.407676:0:24234:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff948a7d76fb80 00010000:00010000:1.0:1788813462.437276:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14593 lines, 14593 kept, 0 dropped, 0 bad.