00010000:00010000:1.0F:1787432800.395460:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1787432801.419660:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1787432801.741192:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432801.741229:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609526272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432801.741298:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432801.741385:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609526144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432801.741410:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432801.741438:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609526272 00000100:00100000:2.0:1787432801.741445:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609526272 00000100:00100000:2.0:1787432801.741489:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609526144 00000100:00100000:2.0:1787432801.741491:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609526144 00000100:00100000:2.0:1787432801.741506:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787432801.741514:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609526272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432801.741545:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787432801.741585:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609526272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432801.741593:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787432801.741618:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787432801.741625:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609526144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432801.741635:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787432801.741660:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609526144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432801.741666:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787432801.741705:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609526144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432801.741744:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609526272:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787432801.744659:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1787432801.749095:0:17134:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1787432801.749121:0:17134:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff948435bf1e40 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:2.0:1787432801.749127:0:17134:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948402acd300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff948435bf1540 00000020:00080000:2.0:1787432801.749139:0:17134:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948402acd900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94843489d000 00010000:00010000:3.0F:1787432801.749266:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564047f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432801.749284:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564047f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432801.749292:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564047f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432801.749298:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f04600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432801.749303:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564047f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432801.749311:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564047f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432801.749338:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948435957d00) 00010000:00010000:3.0:1787432801.749341:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432801.749346:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564047f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432801.749352:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564047f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787432801.749381:0:17193:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:3.0:1787432801.749464:0:17193:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1787432801.749559:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609526400:0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.749676:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432801.749743:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609526400 00000100:00100000:2.0:1787432801.749752:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609526400 00000100:00100000:2.0:1787432801.749799:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787432801.749808:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3642:x1874258609526400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.749858:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3642:x1874258609526400:12345-0@lo:400:kworker.0 Request processed in 51us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432801.749865:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787432801.749914:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609526400:0@lo:400:kworker.0 00000100:00100000:1.0:1787432801.750122:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609526784:0@lo:400:kworker.0 00000100:00100000:1.0:1787432801.750158:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432801.750229:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609527296:0@lo:400:kworker.0 00000100:00100000:1.0:1787432801.750254:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432801.750273:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787432801.750279:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609526912:0@lo:400:kworker.0 00000100:00100000:1.0:1787432801.750303:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432801.750729:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609527424:0@lo:400:kworker.0 00000100:00100000:1.0:1787432801.750758:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432801.750946:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609526784 00000100:00100000:1.0:1787432801.750952:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609526784 00000100:00100000:1.0:1787432801.750987:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609527296 00000100:00100000:1.0:1787432801.750990:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609527296 00000100:00100000:1.0:1787432801.751012:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609527424 00000100:00100000:1.0:1787432801.751014:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609527424 00000100:00100000:1.0:1787432801.751028:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787432801.751035:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609526784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432801.751079:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609526784:12345-0@lo:400:kworker.0 Request processed in 44us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432801.751085:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787432801.751099:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787432801.751105:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609527296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432801.751132:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609527296:12345-0@lo:400:kworker.0 Request processed in 28us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432801.751137:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787432801.751148:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787432801.751154:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609527424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432801.751226:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609527424:12345-0@lo:400:kworker.0 Request processed in 72us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432801.751232:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787432801.751250:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609526912 00000100:00100000:1.0:1787432801.751254:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609526912 00000100:00100000:1.0:1787432801.751278:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787432801.751284:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609526912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432801.752057:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609526912:12345-0@lo:400:kworker.0 Request processed in 771us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432801.752065:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1787432801.752089:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432801.752094:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432801.752122:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609526912:0@lo:400:kworker.0 00010000:00080000:1.0:1787432801.752135:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f941500 x1874258609527424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432801.752145:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609527424:0@lo:400:kworker.0 00000100:00100000:1.0:1787432801.752156:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609526784:0@lo:400:kworker.0 00000100:00100000:1.0:1787432801.752184:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609527296:0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.752867:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609526528:0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.752920:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432801.752959:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609527040:0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.752989:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432801.753005:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609526528 00000100:00100000:1.0:1787432801.753011:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609526528 00000100:00100000:2.0:1787432801.753015:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609527552:0@lo:400:kworker.0 00000100:00100000:1.0:1787432801.753050:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787432801.753056:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432801.753063:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609526528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.753085:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787432801.753094:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609526656:0@lo:400:kworker.0 00000100:00100000:1.0:1787432801.753114:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609526528:12345-0@lo:400:kworker.0 Request processed in 54us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432801.753121:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787432801.753128:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432801.753152:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609527168:0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.753203:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432801.753227:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609527680:0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.753249:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432801.753291:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609526528:0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.753316:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609527552 00000100:00100000:2.0:1787432801.753320:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609527552 00000100:00100000:2.0:1787432801.753360:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609527168 00000100:00100000:2.0:1787432801.753364:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609527168 00000100:00100000:2.0:1787432801.753376:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609527680 00000100:00100000:2.0:1787432801.753378:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609527680 00000100:00100000:2.0:1787432801.753395:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787432801.753402:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609527552:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787432801.753404:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432801.753411:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432801.753458:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609527552:12345-0@lo:400:kworker.0 Request processed in 56us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432801.753465:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787432801.753480:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787432801.753487:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609527168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.753518:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609527168:12345-0@lo:400:kworker.0 Request processed in 31us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432801.753525:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787432801.753534:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609527168:0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.753543:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787432801.753551:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609527680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.753580:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609527680:12345-0@lo:400:kworker.0 Request processed in 30us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432801.753586:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787432801.753631:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609527040 00000100:00100000:2.0:1787432801.753635:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609527040 00000100:00100000:1.0:1787432801.753646:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609527552:0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.753671:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609526656 00000100:00100000:2.0:1787432801.753676:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609526656 00010000:00080000:1.0:1787432801.753679:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f943800 x1874258609527680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432801.753690:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609527680:0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.753704:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787432801.753713:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609527040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.753765:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609527040:12345-0@lo:400:kworker.0 Request processed in 54us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432801.753772:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787432801.753784:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787432801.753791:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609526656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432801.753821:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609527040:0@lo:400:kworker.0 00000100:00100000:2.0:1787432801.753827:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609526656:12345-0@lo:400:kworker.0 Request processed in 34us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432801.753837:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787432801.753843:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609526656:0@lo:400:kworker.0 00000100:00080000:2.0:1787432801.753870:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787432802.444474:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432802.763404:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432802.763439:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609527808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432802.763508:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432802.763790:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609527808 00000100:00100000:0.0:1787432802.763811:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609527808 00000100:00100000:0.0:1787432802.763879:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787432802.763890:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609527808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432802.763919:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787432802.763971:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609527808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432802.763978:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787432802.764034:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609527808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432803.367388:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432803.367436:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432803.367467:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432803.368862:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588480896 00000100:00100000:3.0:1787432803.368873:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588480896 00000100:00100000:3.0:1787432803.368940:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 171 00000100:00100000:3.0:1787432803.368951:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:2400:x1874258588480896:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432803.369021:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:2400:x1874258588480896:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 73us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432803.369045:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 171 00000100:00100000:3.0:1787432803.369221:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588481152 00000100:00100000:3.0:1787432803.369225:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588481152 00000100:00100000:3.0:1787432803.369261:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588481024 00000100:00100000:3.0:1787432803.369264:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588481024 00000100:00100000:3.0:1787432803.369285:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 79 00000100:00100000:3.0:1787432803.369293:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2400:x1874258588481152:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432803.369330:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2400:x1874258588481152:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 38us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432803.369337:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 79 00000100:00100000:3.0:1787432803.369350:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 80 00000100:00100000:3.0:1787432803.369357:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+13:2400:x1874258588481024:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432803.369384:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+13:2400:x1874258588481024:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (1916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432803.369389:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 80 00000100:00080000:3.0:1787432803.369410:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432803.369413:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432803.377435:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432803.377474:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432803.377508:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432803.377853:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588481408 00000100:00100000:2.0:1787432803.377863:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588481408 00000100:00100000:2.0:1787432803.377942:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 34 00000100:00100000:2.0:1787432803.377955:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2401:x1874258588481408:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432803.378032:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2401:x1874258588481408:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 80us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432803.378041:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 34 00000100:00100000:3.0:1787432803.378121:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588481664 00000100:00100000:3.0:1787432803.378126:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588481664 00000100:00100000:3.0:1787432803.378187:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588481536 00000100:00100000:3.0:1787432803.378190:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588481536 00000100:00100000:3.0:1787432803.378213:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 81 00000100:00100000:3.0:1787432803.378221:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2401:x1874258588481664:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432803.378254:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2401:x1874258588481664:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 33us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432803.378261:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 81 00000100:00100000:3.0:1787432803.378287:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 82 00000100:00100000:3.0:1787432803.378294:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2401:x1874258588481536:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432803.378335:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2401:x1874258588481536:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 41us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432803.378342:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 82 00000100:00080000:3.0:1787432803.378364:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432803.378368:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432803.378370:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432803.382495:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432803.382541:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432803.382596:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432803.382625:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588481280 00000100:00100000:3.0:1787432803.382635:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588481280 00000100:00100000:3.0:1787432803.382688:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588481792 00000100:00100000:3.0:1787432803.382690:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588481792 00000100:00100000:3.0:1787432803.382702:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588481920 00000100:00100000:3.0:1787432803.382704:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588481920 00000100:00100000:3.0:1787432803.382722:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 29 00000100:00100000:1.0:1787432803.382832:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:1.0:1787432803.382842:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2399:x1874258588481792:12345-192.168.204.24@tcp:9:kworker.0 00000020:00000080:1.0:1787432803.382874:0:19127:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b3356401ed 00000100:00080000:1.0:1787432803.382890:0:19127:0:(import.c:65:import_set_state_nolock()) ffff94842d4c6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787432803.382932:0:19127:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1787432803.383088:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fd65f33-d046-43bb-9119-74a1dce1ebb4+2:2399:x1874258588481792:12345-192.168.204.24@tcp:9:kworker.0 Request processed in 248us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432803.383095:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:1.0:1787432803.383114:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00100000:1.0:1787432803.383121:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2399:x1874258588481920:12345-192.168.204.24@tcp:9:kworker.0 00000020:00000080:1.0:1787432803.383134:0:19127:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b3356401f4 00000100:00080000:1.0:1787432803.383141:0:19127:0:(import.c:65:import_set_state_nolock()) ffff9484348a7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787432803.383184:0:19127:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1787432803.383259:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fd65f33-d046-43bb-9119-74a1dce1ebb4+2:2399:x1874258588481920:12345-192.168.204.24@tcp:9:kworker.0 Request processed in 137us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432803.383277:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 31 00010000:00010000:1.0:1787432803.383333:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432803.384987:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787432803.385595:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432803.385601:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432803.391700:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2399:x1874258588481280:12345-192.168.204.24@tcp:9:kworker.0 00000020:00000080:3.0:1787432803.392043:0:18661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b3356401ae 00000100:00080000:3.0:1787432803.392055:0:18661:0:(import.c:65:import_set_state_nolock()) ffff94842d4c4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787432803.396472:0:18661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787432803.396657:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+2:2399:x1874258588481280:12345-192.168.204.24@tcp:9:kworker.0 Request processed in 13921us (14169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432803.396669:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 29 00010000:00010000:1.0:1787432803.399208:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432803.467676:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432803.791160:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609527936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432803.791269:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432803.792183:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609527936 00000100:00100000:1.0:1787432803.792195:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609527936 00000100:00100000:1.0:1787432803.792248:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787432803.792258:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609527936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787432803.792292:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787432803.792374:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609527936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432803.792381:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787432803.792431:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609527936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787432803.792540:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432803.792552:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609528064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432803.792597:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432803.798127:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609528064 00000100:00100000:0.0:1787432803.798138:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609528064 00000100:00100000:0.0:1787432803.798222:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787432803.798233:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609528064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432803.798257:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787432803.798350:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609528064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (5751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432803.798358:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787432803.800697:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432803.800735:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609528192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432803.800827:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787432803.800892:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432803.802631:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609528064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432803.802866:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609528192 00000100:00100000:0.0:1787432803.802875:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609528192 00000100:00100000:0.0:1787432803.802936:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787432803.802946:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609528192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432803.802989:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787432803.803088:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609528192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432803.803096:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787432803.807004:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609528192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432804.154897:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432804.155053:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588482048 00000100:00100000:0.0:1787432804.155064:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588482048 00000100:00100000:0.0:1787432804.155139:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 65 00000100:00100000:0.0:1787432804.155153:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+13:15619:x1874258588482048:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787432804.155277:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+13:15619:x1874258588482048:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 127us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432804.155285:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 65 00000100:00100000:3.0:1787432804.163340:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432804.163392:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588482176 00000100:00100000:3.0:1787432804.163414:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588482176 00000100:00100000:3.0:1787432804.163476:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 66 00000100:00100000:3.0:1787432804.163487:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+5:15619:x1874258588482176:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787432804.163607:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+5:15619:x1874258588482176:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 122us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432804.163616:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 66 00000100:00100000:1.0:1787432804.198425:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432804.198841:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588482432 00000100:00100000:3.0:1787432804.198853:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588482432 00000100:00100000:3.0:1787432804.198948:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:3.0:1787432804.198960:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+13:15619:x1874258588482432:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787432804.199214:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+14:15619:x1874258588482432:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 256us (798us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787432804.199223:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 12 00010000:00010000:0.0:1787432804.493293:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787432805.195477:0:17189:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787432805.195487:0:17189:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787432805.195522:0:17189:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787432805.195539:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787432805.516712:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432806.539635:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432806.859493:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609528320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432806.859584:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432806.860391:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609528448:0@lo:400:kworker.0 00000100:00100000:1.0:1787432806.860435:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432806.860539:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609528320 00000100:00100000:3.0:1787432806.860547:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609528320 00000100:00100000:3.0:1787432806.860603:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787432806.860614:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609528320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432806.860641:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787432806.860800:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609528320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 187us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432806.860808:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1787432806.860831:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432806.860933:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609528576:0@lo:400:kworker.0 00000100:00100000:3.0:1787432806.860962:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432806.882874:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609528704:0@lo:400:kworker.0 00000100:00100000:2.0:1787432806.882987:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432806.883102:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609528832:0@lo:400:kworker.0 00000100:00100000:0.0:1787432806.883136:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432806.885299:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609528960:0@lo:400:kworker.0 00000100:00100000:1.0:1787432806.885386:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432806.885427:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609529472:0@lo:400:kworker.0 00000100:00100000:1.0:1787432806.885451:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432806.885514:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609528576 00000100:00100000:1.0:1787432806.885523:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609528576 00000100:00100000:1.0:1787432806.885569:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609528960 00000100:00100000:1.0:1787432806.885573:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609528960 00000100:00100000:1.0:1787432806.885615:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787432806.885761:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609528576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432806.885821:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609528576:12345-0@lo:400:kworker.0 Request processed in 198us (24857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432806.885829:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787432806.885848:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787432806.885854:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609528960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432806.885888:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609528960:12345-0@lo:400:kworker.0 Request processed in 34us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432806.885894:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787432806.885913:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609528704 00000100:00100000:1.0:1787432806.885917:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609528704 00000100:00100000:1.0:1787432806.885954:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787432806.885961:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609528704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432806.886372:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609528704:12345-0@lo:400:kworker.0 Request processed in 410us (3383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432806.886380:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787432806.886405:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609528832 00000100:00100000:1.0:1787432806.886409:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609528832 00000100:00100000:1.0:1787432806.886449:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609529472 00000100:00100000:1.0:1787432806.886453:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609529472 00000100:00100000:1.0:1787432806.886478:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787432806.886487:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609528832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432806.887094:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609528832:12345-0@lo:400:kworker.0 Request processed in 608us (3956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432806.887103:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787432806.887851:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787432806.887864:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609529472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432806.887915:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609529472:12345-0@lo:400:kworker.0 Request processed in 55us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432806.887921:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1787432806.887964:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432806.887970:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432806.888785:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609528960:0@lo:400:kworker.0 00000100:00100000:1.0:1787432806.888800:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609529472:0@lo:400:kworker.0 00000100:00100000:1.0:1787432806.888880:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609528448 00000100:00100000:1.0:1787432806.888887:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609528448 00000100:00100000:1.0:1787432806.888936:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787432806.888944:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3642:x1874258609528448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432806.889283:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609528576:0@lo:400:kworker.0 00000100:00100000:3.0:1787432806.889312:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609529088:0@lo:400:kworker.0 00000100:00100000:2.0:1787432806.890877:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609528704:0@lo:400:kworker.0 00000100:00100000:2.0:1787432806.890892:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609529216:0@lo:400:kworker.0 00000100:00100000:0.0:1787432806.894809:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609528832:0@lo:400:kworker.0 00000100:00100000:0.0:1787432806.894842:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609529344:0@lo:400:kworker.0 00000100:00100000:3.0:1787432806.895377:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432806.895426:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609529600:0@lo:400:kworker.0 00000100:00100000:3.0:1787432806.895460:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432806.903717:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609529600 00000100:00100000:3.0:1787432806.903732:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609529600 00000100:00100000:3.0:1787432806.904001:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787432806.904015:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609529600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432806.904109:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609529600:12345-0@lo:400:kworker.0 Request processed in 99us (8647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432806.904117:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1787432806.904144:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787432806.905404:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f918a80 x1874258609529600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432806.905422:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609529600:0@lo:400:kworker.0 00000100:00100000:3.0:1787432806.905598:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609529088 00000100:00100000:3.0:1787432806.905606:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609529088 00000100:00100000:3.0:1787432806.906114:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787432806.906125:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609529088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432806.906946:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609529088:12345-0@lo:400:kworker.0 Request processed in 818us (11565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432806.906958:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787432806.906996:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432806.907033:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609529088:0@lo:400:kworker.0 00000100:00100000:3.0:1787432806.907069:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609529984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432806.907123:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432806.907155:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609528448:0@lo:400:kworker.0 00000100:00100000:3.0:1787432806.909470:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609529984 00000100:00100000:3.0:1787432806.909484:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609529984 00000100:00100000:3.0:1787432806.909581:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787432806.909592:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609529984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787432806.909616:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787432806.910520:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3642:x1874258609528448:12345-0@lo:400:kworker.0 Request processed in 21570us (50079us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432806.910532:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787432806.911305:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609529984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1712us (4179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432806.911316:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787432806.912663:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432806.912723:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f91bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609529728:0@lo:400:kworker.0 00000100:00100000:2.0:1787432806.912763:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432806.912837:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609529216 00000100:00100000:2.0:1787432806.912845:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609529216 00000100:00100000:2.0:1787432806.912895:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787432806.912907:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609529216:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787432806.912941:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432806.913068:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609529984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432806.914186:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609529728 00000100:00100000:3.0:1787432806.914294:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609529728 00000100:00100000:3.0:1787432806.914361:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787432806.914371:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609529728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432806.915559:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609529216:12345-0@lo:400:kworker.0 Request processed in 2648us (2895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432806.915573:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787432806.915637:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609529216:0@lo:400:kworker.0 00000100:00080000:2.0:1787432806.915680:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432806.922683:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609529728:12345-0@lo:400:kworker.0 Request processed in 8302us (9907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432806.922700:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787432806.922885:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f91bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609529728:0@lo:400:kworker.0 00000100:00100000:0.0:1787432806.924687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432806.924751:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609529856:0@lo:400:kworker.0 00000100:00100000:0.0:1787432806.924812:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432806.925052:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609528320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432806.928601:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609529344 00000100:00100000:1.0:1787432806.928617:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609529344 00000100:00100000:1.0:1787432806.928746:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609529856 00000100:00100000:1.0:1787432806.928752:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609529856 00000100:00080000:0.0:1787432806.929398:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432806.929576:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787432806.929592:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609529344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432806.929686:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609529344:12345-0@lo:400:kworker.0 Request processed in 101us (5007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432806.929972:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787432806.930014:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609529856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432806.930055:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609529856:12345-0@lo:400:kworker.0 Request processed in 74us (5242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432806.930063:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787432806.933410:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609529344:0@lo:400:kworker.0 00010000:00080000:0.0:1787432806.933432:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039b5f80 x1874258609529856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432806.933443:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609529856:0@lo:400:kworker.0 00000100:00100000:1.0:1787432806.933906:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:0.0:1787432807.563479:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787432807.889652:0:17134:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1787432807.889672:0:17134:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:3.0:1787432807.889790:0:17193:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:3.0:1787432807.889810:0:17193:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000100:00100000:3.0:1787432807.890386:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609530112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432807.890456:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432807.890567:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609530112 00000100:00100000:2.0:1787432807.890575:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609530112 00000100:00100000:2.0:1787432807.890643:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787432807.890654:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609530112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432807.890687:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787432807.890748:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609530112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432807.890755:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787432807.891218:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609530112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432808.472714:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432808.472878:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588482560 00000100:00100000:2.0:1787432808.472902:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588482560 00000100:00100000:2.0:1787432808.472974:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 173 00000100:00100000:2.0:1787432808.472986:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:2403:x1874258588482560:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432808.473088:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:2403:x1874258588482560:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 103us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432808.473096:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 173 00000100:00100000:1.0:1787432808.479008:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432808.479062:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432808.479094:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432808.479116:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432808.479141:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432808.479183:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588482816 00000100:00100000:1.0:1787432808.479193:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588482816 00000100:00100000:1.0:1787432808.479243:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588483072 00000100:00100000:1.0:1787432808.479247:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588483072 00000100:00100000:1.0:1787432808.479259:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588482688 00000100:00100000:1.0:1787432808.479261:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588482688 00000100:00100000:1.0:1787432808.479273:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588483200 00000100:00100000:1.0:1787432808.479276:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588483200 00000100:00100000:1.0:1787432808.479291:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 89 00000100:00100000:1.0:1787432808.479301:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588482816:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432808.479380:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588482816:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 80us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432808.479401:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 89 00000100:00100000:1.0:1787432808.479421:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 90 00000100:00100000:1.0:1787432808.479428:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2403:x1874258588483072:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432808.479454:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2403:x1874258588483072:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432808.479684:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 91 00000100:00100000:0.0:1787432808.479695:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+13:2403:x1874258588482688:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432808.479741:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+13:2403:x1874258588482688:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 48us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432808.479748:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 91 00000100:00100000:0.0:1787432808.479763:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 92 00000100:00100000:0.0:1787432808.479770:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588483200:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432808.479793:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588483200:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432808.479799:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 92 00000100:00080000:0.0:1787432808.479818:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787432808.479822:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432808.479991:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 90 00000100:00100000:3.0:1787432808.481083:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588482944 00000100:00100000:3.0:1787432808.481097:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588482944 00000100:00100000:3.0:1787432808.481157:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 38 00000100:00100000:3.0:1787432808.481186:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588482944:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432808.481246:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588482944:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 80us (2129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432808.481254:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 38 00000100:00080000:0.0:1787432808.482197:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787432808.598373:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787432808.705538:0:20530:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 17:06:46 (1787432806) 00000100:00100000:0.0:1787432808.915612:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609530368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432808.915705:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432808.916055:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609530240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432808.916091:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432808.916133:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609530368 00000100:00100000:1.0:1787432808.916139:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609530368 00000100:00100000:1.0:1787432808.916223:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787432808.916233:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609530368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787432808.916268:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787432808.916317:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609530368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432808.916324:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787432808.916520:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609530240 00000100:00100000:1.0:1787432808.916524:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609530240 00000100:00100000:1.0:1787432808.916607:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787432808.916615:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609530240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787432808.916769:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787432808.916809:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609530240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 195us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432808.916816:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787432808.917208:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609530240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432808.917249:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609530368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432808.917261:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432808.917277:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609530496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432808.920896:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432808.921287:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609530496 00000100:00100000:1.0:1787432808.921295:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609530496 00000100:00100000:1.0:1787432808.924866:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787432808.924899:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609530496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787432808.924946:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787432808.925043:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609530496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 161us (4154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432808.925051:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787432808.930225:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432808.930512:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609530496:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1787432808.948325:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 17ee1936-2707-48b4-a113-f80e95ac94b4 00000020:00000080:3.0:1787432808.948333:0:18655:0:(genops.c:885:class_export_put()) final put ffff94842d4c0800/17ee1936-2707-48b4-a113-f80e95ac94b4 00000001:00100000:3.0:1787432808.948471:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9fd65f33-d046-43bb-9119-74a1dce1ebb4 00000020:00000080:3.0:1787432808.948475:0:18655:0:(genops.c:885:class_export_put()) final put ffff94842d4c5000/9fd65f33-d046-43bb-9119-74a1dce1ebb4 00000001:00100000:2.0:1787432808.948555:0:19475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9fd65f33-d046-43bb-9119-74a1dce1ebb4 00000020:00000080:2.0:1787432808.948559:0:19475:0:(genops.c:885:class_export_put()) final put ffff948301e05800/9fd65f33-d046-43bb-9119-74a1dce1ebb4 00000020:00000080:0.0:1787432808.953482:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94842d4c0800/17ee1936-2707-48b4-a113-f80e95ac94b4 for lustre-OST0000 00000020:00000080:0.0:1787432808.953563:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94842d4c4000 for lustre-OST0000 00000020:00000080:0.0:1787432808.959448:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff94842d4c5000/9fd65f33-d046-43bb-9119-74a1dce1ebb4 for lustre-OST0000 00000020:00000080:0.0:1787432808.959520:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff948301e05800/9fd65f33-d046-43bb-9119-74a1dce1ebb4 for lustre-OST0001 00000020:00000080:0.0:1787432808.959538:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94842d4c6800 for lustre-OST0000 00000020:00000080:0.0:1787432808.959553:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9484348a7000 for lustre-OST0001 00000040:00080000:3.0:1787432809.036901:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787432809.625970:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432810.640287:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432811.669676:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432811.981345:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609530624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432811.981450:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432811.981721:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609530624 00000100:00100000:3.0:1787432811.981731:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609530624 00000100:00100000:3.0:1787432811.981804:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787432811.981816:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609530624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787432811.981848:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787432811.981899:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609530624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432811.981906:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787432811.981950:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609530624:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787432811.982069:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432811.982298:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609530880:0@lo:400:kworker.0 00000100:00100000:0.0:1787432811.982333:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432811.982361:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609531392:0@lo:400:kworker.0 00000100:00100000:0.0:1787432811.982381:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432811.982395:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609531904:0@lo:400:kworker.0 00000100:00100000:0.0:1787432811.982433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432811.982454:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787432811.982461:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609531008:0@lo:400:kworker.0 00000100:00100000:0.0:1787432811.982484:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432811.982500:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609531520:0@lo:400:kworker.0 00000100:00100000:0.0:1787432811.982520:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432811.982534:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609532032:0@lo:400:kworker.0 00000100:00100000:0.0:1787432811.982558:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432811.982586:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609531904 00000100:00100000:0.0:1787432811.982590:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609531904 00000100:00100000:0.0:1787432811.982622:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609532032 00000100:00100000:0.0:1787432811.982625:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609532032 00000100:00100000:0.0:1787432811.982642:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787432811.982657:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609531904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432811.982698:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609531904:12345-0@lo:400:kworker.0 Request processed in 42us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432811.982704:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787432811.982719:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787432811.982726:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609532032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432811.982754:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609532032:12345-0@lo:400:kworker.0 Request processed in 29us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432811.982760:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787432811.982795:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609532032:0@lo:400:kworker.0 00010000:00080000:0.0:1787432811.982808:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303a38e00 x1874258609531904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432811.982818:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609531904:0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.982905:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609531008 00000100:00100000:2.0:1787432811.982910:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609531008 00000100:00100000:2.0:1787432811.982947:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609531520 00000100:00100000:2.0:1787432811.982951:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609531520 00000100:00100000:2.0:1787432811.982973:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787432811.982981:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609531008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983019:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609531008:12345-0@lo:400:kworker.0 Request processed in 39us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432811.983026:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787432811.983039:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787432811.983045:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609531520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983069:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609531520:12345-0@lo:400:kworker.0 Request processed in 25us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432811.983075:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787432811.983098:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609531136:0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983133:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432811.983149:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609531648:0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983197:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432811.983215:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609532160:0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983234:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432811.983252:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787432811.983257:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609530752:0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983280:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432811.983299:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609531264:0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983314:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432811.983322:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609531776:0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983338:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432811.983354:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609531648 00000100:00100000:2.0:1787432811.983357:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609531648 00000100:00100000:2.0:1787432811.983374:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609532160 00000100:00100000:2.0:1787432811.983376:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609532160 00000100:00100000:2.0:1787432811.983388:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609531264 00000100:00100000:2.0:1787432811.983390:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609531264 00000100:00100000:2.0:1787432811.983415:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609531776 00000100:00100000:2.0:1787432811.983417:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609531776 00000100:00100000:2.0:1787432811.983432:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787432811.983437:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609531648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983470:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609531648:12345-0@lo:400:kworker.0 Request processed in 33us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432811.983476:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787432811.983489:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787432811.983495:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609532160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983530:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609532160:12345-0@lo:400:kworker.0 Request processed in 36us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432811.983537:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787432811.983549:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787432811.983554:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609531264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983577:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609531264:12345-0@lo:400:kworker.0 Request processed in 24us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432811.983582:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787432811.983593:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787432811.983598:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609531776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983617:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609531776:12345-0@lo:400:kworker.0 Request processed in 20us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432811.983622:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787432811.983636:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609531136 00000100:00100000:2.0:1787432811.983639:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609531136 00000100:00100000:2.0:1787432811.983659:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787432811.983665:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609531136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983688:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609531136:12345-0@lo:400:kworker.0 Request processed in 24us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432811.983694:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787432811.983725:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609531008:0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983736:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609531520:0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983762:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609531264:0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983769:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609531776:0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983786:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609531136:0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.983793:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609531648:0@lo:400:kworker.0 00010000:00080000:2.0:1787432811.983801:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303a3b100 x1874258609532160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432811.983810:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609532160:0@lo:400:kworker.0 00000100:00100000:1.0:1787432811.983899:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609530880 00000100:00100000:1.0:1787432811.983903:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609530880 00000100:00100000:1.0:1787432811.983938:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609531392 00000100:00100000:1.0:1787432811.983940:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609531392 00000100:00100000:1.0:1787432811.983952:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787432811.983958:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609530880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432811.983995:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609530880:12345-0@lo:400:kworker.0 Request processed in 38us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432811.984000:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787432811.984013:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787432811.984018:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609531392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432811.984039:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609531392:12345-0@lo:400:kworker.0 Request processed in 22us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432811.984044:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787432811.984065:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609530752 00000100:00100000:1.0:1787432811.984075:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609530752 00000100:00100000:1.0:1787432811.984099:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787432811.984105:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3643:x1874258609530752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432811.984136:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3643:x1874258609530752:12345-0@lo:400:kworker.0 Request processed in 32us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432811.984142:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:1.0:1787432811.984195:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432811.984199:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432811.984202:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432811.984204:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432811.984221:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609530880:0@lo:400:kworker.0 00000100:00100000:1.0:1787432811.984230:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609531392:0@lo:400:kworker.0 00000100:00100000:1.0:1787432811.984251:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609530752:0@lo:400:kworker.0 00000100:00100000:2.0:1787432811.984492:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432811.984502:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609532288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432811.984533:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432811.984638:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609532288 00000100:00100000:3.0:1787432811.984642:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609532288 00000100:00100000:3.0:1787432811.984677:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787432811.984684:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609532288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432811.984698:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787432811.984791:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609532288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432811.984798:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787432811.984876:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609532288:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787432812.686643:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432813.004196:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432813.004220:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609532416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432813.004288:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432813.004389:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609532416 00000100:00100000:2.0:1787432813.004397:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609532416 00000100:00100000:2.0:1787432813.004467:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787432813.004479:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609532416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432813.004509:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787432813.004557:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609532416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432813.004563:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787432813.004649:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432813.004715:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609532416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432813.233968:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432813.234127:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588483456 00000100:00100000:2.0:1787432813.234139:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588483456 00000100:00100000:2.0:1787432813.234249:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00100000:2.0:1787432813.234262:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+13:16380:x1874258588483456:12345-192.168.204.24@tcp:35:umount.0 00000100:00080000:0.0:1787432813.234467:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1787432813.234631:0:17158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1787432813.234722:0:17158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:2.0:1787432813.235141:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+16:16380:x1874258588483456:12345-192.168.204.24@tcp:35:umount.0 Request processed in 879us (1180us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1787432813.235200:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 13 00000020:00080000:2.0:1787432813.235206:0:17158:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787432813.238342:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432813.238402:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432813.238501:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588483712 00000100:00100000:1.0:1787432813.238511:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588483712 00000100:00100000:1.0:1787432813.238575:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588483584 00000100:00100000:1.0:1787432813.238578:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588483584 00000100:00100000:1.0:1787432813.238619:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:1.0:1787432813.238630:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+14:2401:x1874258588483712:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432813.238647:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432813.238669:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94843f85fa00/0xca72b3b335640192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5166 expref: 14 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432813.238687:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432813.238751:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:2401:x1874258588483712:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 123us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432813.238760:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:1.0:1787432813.238780:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:1.0:1787432813.238786:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+12:2401:x1874258588483584:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432813.238794:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432813.238804:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94843f85f200/0xca72b3b33564018b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5135 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432813.238814:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432813.238832:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:2401:x1874258588483584:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 46us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432813.238838:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:3.0:1787432813.241554:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432813.241666:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588483840 00000100:00100000:1.0:1787432813.241679:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588483840 00000100:00100000:1.0:1787432813.241748:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:1.0:1787432813.241760:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:2403:x1874258588483840:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432813.241776:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432813.241796:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948302691600/0xca72b3b33564024f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d521c expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432813.241812:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432813.241873:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+10:2403:x1874258588483840:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 114us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432813.241880:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:1.0:1787432813.244950:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432813.245323:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588483968 00000100:00100000:2.0:1787432813.245335:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588483968 00000100:00080000:0.0:1787432813.245474:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432813.245523:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 32 00000100:00100000:2.0:1787432813.245537:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2399:x1874258588483968:12345-192.168.204.24@tcp:9:umount.0 00000020:00000080:2.0:1787432813.245574:0:18661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b3356401b5 00000100:00080000:2.0:1787432813.245583:0:18661:0:(import.c:65:import_set_state_nolock()) ffff94842d4c2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432813.245641:0:18661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1787432813.245799:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+2:2399:x1874258588483968:12345-192.168.204.24@tcp:9:umount.0 Request processed in 265us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432813.245808:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 32 00010000:00010000:0.0:1787432813.245858:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432813.254458:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432813.254543:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588484864 00000100:00100000:0.0:1787432813.254553:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588484864 00000100:00100000:0.0:1787432813.254620:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00100000:0.0:1787432813.254630:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+16:2399:x1874258588484864:12345-192.168.204.24@tcp:39:umount.0 00000020:00000080:0.0:1787432813.254665:0:17154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b3356401a0 00000020:00010000:0.0:1787432813.254681:0:17154:0:(genops.c:1921:obd_stale_export_put()) Put export ffff948301e40000: total 0 00000100:00080000:0.0:1787432813.254686:0:17154:0:(import.c:65:import_set_state_nolock()) ffff94842d4c1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787432813.254730:0:17154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1787432813.254886:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+15:2399:x1874258588484864:12345-192.168.204.24@tcp:39:umount.0 Request processed in 256us (437us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1787432813.254895:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 67 00000020:00010000:1.0:1787432813.255019:0:19769:0:(genops.c:1907:obd_stale_export_get()) Get export ffff948301e40000: total 0 00010000:00010000:1.0:1787432813.255038:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432813.255093:0:19769:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff948301e40000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787432813.255200:0:19769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948435957d00) 00010000:00010000:1.0:1787432813.255204:0:19769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787432813.255213:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b335640455 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52b6 expref: 14 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432813.255239:0:19769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:1.0:1787432813.255242:0:19769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787432813.255246:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356404b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52d2 expref: 13 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432813.255258:0:19769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff948435964600) 00010000:00010000:1.0:1787432813.255261:0:19769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432813.255265:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33564026b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5223 expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432813.255280:0:19769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948418e86200) 00010000:00010000:1.0:1787432813.255283:0:19769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787432813.255287:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04800/0xca72b3b33564034b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5262 expref: 11 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432813.255300:0:19769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:1.0:1787432813.255303:0:19769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787432813.255307:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b3356403fa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52a1 expref: 10 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432813.255318:0:19769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:1.0:1787432813.255320:0:19769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787432813.255331:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b3356403c9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d528c expref: 9 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432813.255348:0:19769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948435964e00) 00010000:00010000:1.0:1787432813.255350:0:19769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432813.255354:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd000/0xca72b3b335640287 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d522a expref: 8 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432813.255368:0:19769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957900) 00010000:00010000:1.0:1787432813.255370:0:19769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432813.255388:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b3356402c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5238 expref: 7 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432813.255399:0:19769:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff948301e40000, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1787432813.255413:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432813.255415:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432813.255416:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432813.265313:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432813.265453:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588484992 00000100:00100000:2.0:1787432813.265465:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588484992 00000100:00100000:2.0:1787432813.265617:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 68 00000100:00100000:2.0:1787432813.265629:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2399:x1874258588484992:12345-192.168.204.24@tcp:39:umount.0 00000020:00000080:2.0:1787432813.265667:0:20092:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b3356401a7 00000100:00080000:2.0:1787432813.265684:0:20092:0:(import.c:65:import_set_state_nolock()) ffff94842d4c3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432813.265714:0:20092:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1787432813.265963:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+3:2399:x1874258588484992:12345-192.168.204.24@tcp:39:umount.0 Request processed in 335us (659us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787432813.265972:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 68 00010000:00010000:1.0:1787432813.266295:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432813.270732:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432813.589907:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432813.589948:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432813.594219:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588485248 00000100:00100000:2.0:1787432813.594240:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588485248 00000100:00100000:0.0:1787432813.594263:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588485120 00000100:00100000:0.0:1787432813.594270:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588485120 00000100:00100000:2.0:1787432813.594350:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 99 00000100:00100000:2.0:1787432813.594393:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2401:x1874258588485248:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432813.594516:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2401:x1874258588485248:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 128us (4619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432813.594525:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 99 00000100:00100000:0.0:1787432813.595249:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 100 00000100:00100000:0.0:1787432813.595261:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2401:x1874258588485120:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432813.595316:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2401:x1874258588485120:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 57us (5366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432813.595323:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 100 00000100:00080000:3.0:1787432813.601730:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432813.601741:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787432813.707556:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432814.028780:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432814.028802:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609532672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432814.028835:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432814.028848:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609532544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432814.028873:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432814.028897:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609532672 00000100:00100000:1.0:1787432814.028905:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609532672 00000100:00100000:0.0:1787432814.028941:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432814.028956:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609532544 00000100:00100000:1.0:1787432814.028960:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609532544 00000100:00100000:1.0:1787432814.028982:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787432814.028990:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787432814.028993:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609532672:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432814.029004:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609532544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787432814.029030:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000004:00000024:0.0:1787432814.029030:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787432814.029082:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609532672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432814.029102:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787432814.029151:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609532672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432814.029303:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609532544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 302us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432814.029311:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787432814.029344:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609532544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432814.029897:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432814.029912:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609532800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432814.029957:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432814.030036:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609532800 00000100:00100000:2.0:1787432814.030042:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609532800 00000100:00100000:2.0:1787432814.031028:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787432814.031043:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609532800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787432814.031074:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787432814.031376:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609532800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432814.031486:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609532800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432814.031495:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787432814.034012:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787432814.731684:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787432815.435477:0:17189:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787432815.435496:0:17189:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432815.435516:0:17189:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787432815.435530:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787432815.755645:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432816.105054:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432816.105101:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432816.105286:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588485376 00000100:00100000:1.0:1787432816.105296:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588485376 00000100:00100000:1.0:1787432816.105368:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588485504 00000100:00100000:1.0:1787432816.105372:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588485504 00000100:00100000:1.0:1787432816.105398:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:1.0:1787432816.105408:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:2402:x1874258588485376:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432816.105425:0:18685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432816.105445:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948304488000/0xca72b3b3356401d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d51d6 expref: 11 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432816.105463:0:18685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432816.105517:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15916cf8-04d2-4c09-9229-fbbbb74d56ef+10:2402:x1874258588485376:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 110us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432816.105525:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:1.0:1787432816.105545:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:1.0:1787432816.105552:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15916cf8-04d2-4c09-9229-fbbbb74d56ef+9:2402:x1874258588485504:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432816.105561:0:18685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432816.105570:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948301f05c00/0xca72b3b335640248 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5215 expref: 9 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432816.105578:0:18685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432816.105623:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15916cf8-04d2-4c09-9229-fbbbb74d56ef+8:2402:x1874258588485504:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 72us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432816.105630:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:2.0:1787432816.129620:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432816.129718:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588485632 00000100:00100000:1.0:1787432816.129728:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588485632 00000100:00100000:1.0:1787432816.129789:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:1.0:1787432816.129799:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15916cf8-04d2-4c09-9229-fbbbb74d56ef+8:2401:x1874258588485632:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432816.129817:0:18685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432816.129837:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948304488200/0xca72b3b3356401ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d51a5 expref: 8 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432816.129858:0:18685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432816.129908:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15916cf8-04d2-4c09-9229-fbbbb74d56ef+7:2401:x1874258588485632:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 110us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432816.129915:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:1.0:1787432816.133036:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432816.133133:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588485888 00000100:00100000:2.0:1787432816.133142:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588485888 00000100:00100000:2.0:1787432816.133254:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:2.0:1787432816.133266:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2399:x1874258588485888:12345-192.168.204.24@tcp:39:umount.0 00000020:00000080:2.0:1787432816.133312:0:17155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b3356401df 00000020:00010000:2.0:1787432816.133331:0:17155:0:(genops.c:1921:obd_stale_export_put()) Put export ffff948304716000: total 0 00000100:00080000:2.0:1787432816.133336:0:17155:0:(import.c:65:import_set_state_nolock()) ffff948304712000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432816.133368:0:17155:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1787432816.133534:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2399:x1874258588485888:12345-192.168.204.24@tcp:39:umount.0 Request processed in 270us (517us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1787432816.133542:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 69 00000020:00010000:1.0:1787432816.134015:0:17143:0:(genops.c:1907:obd_stale_export_get()) Get export ffff948304716000: total 0 00010000:00010000:1.0:1787432816.134073:0:17143:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff948304716000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787432816.134129:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957900) 00010000:00010000:1.0:1787432816.134133:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432816.134140:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b3356402d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d523f expref: 4 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432816.134183:0:17143:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff948304716000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787432816.134196:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432816.134198:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432816.134200:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787432816.134541:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432816.160034:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432816.165254:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588486016 00000100:00100000:2.0:1787432816.165269:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588486016 00000100:00100000:2.0:1787432816.165385:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00100000:2.0:1787432816.165396:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2399:x1874258588486016:12345-192.168.204.24@tcp:39:umount.0 00000020:00000080:2.0:1787432816.165442:0:17156:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b3356401e6 00000100:00080000:2.0:1787432816.165452:0:17156:0:(import.c:65:import_set_state_nolock()) ffff948304714000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432816.165481:0:17156:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1787432816.165640:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+3:2399:x1874258588486016:12345-192.168.204.24@tcp:39:umount.0 Request processed in 245us (5615us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787432816.165649:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 70 00010000:00010000:1.0:1787432816.165917:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787432816.166224:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432816.206150:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432816.206241:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588486272 00000100:00100000:3.0:1787432816.206252:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588486272 00000100:00100000:3.0:1787432816.206325:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 175 00000100:00100000:3.0:1787432816.206335:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403060850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+7:2399:x1874258588486272:12345-192.168.204.24@tcp:251:umount.0 00000020:00000080:3.0:1787432816.206379:0:17147:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33564017d 00000020:00010000:3.0:1787432816.206387:0:17147:0:(genops.c:1921:obd_stale_export_put()) Put export ffff948301e45000: total 0 00000100:00080000:3.0:1787432816.206392:0:17147:0:(import.c:65:import_set_state_nolock()) ffff948301e45800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787432816.206491:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403060850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+3:2399:x1874258588486272:12345-192.168.204.24@tcp:251:umount.0 Request processed in 156us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432816.206498:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 175 00000020:00010000:2.0:1787432816.208769:0:17142:0:(genops.c:1907:obd_stale_export_get()) Get export ffff948301e45000: total 0 00010000:00010000:2.0:1787432816.208838:0:17142:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff948301e45000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787432816.209234:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948304489a00/0xca72b3b335640184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d512e expref: 2 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432816.209254:0:17142:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff948301e45000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787432816.209268:0:17142:0:(genops.c:885:class_export_put()) final put ffff948301e45000/15916cf8-04d2-4c09-9229-fbbbb74d56ef 00010000:00010000:2.0:1787432816.209294:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432816.209296:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432816.209298:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787432816.209806:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948301e45000/15916cf8-04d2-4c09-9229-fbbbb74d56ef for MGS 00000020:00000080:1.0:1787432816.209857:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948301e45800 for MGS 00010000:00010000:0.0:1787432816.782743:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432817.099504:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843b3c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609533184:0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.099579:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432817.099627:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843b3c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609533696:0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.099646:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432817.099661:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843b3c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609534208:0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.099680:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432817.099701:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787432817.099706:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843b3cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609533312:0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.099726:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432817.099745:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843b3c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609533824:0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.099763:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432817.099781:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843b3ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609534336:0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.099809:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432817.099849:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609533184 00000100:00100000:3.0:1787432817.099857:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609533184 00000100:00100000:3.0:1787432817.099923:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609533696 00000100:00100000:3.0:1787432817.099936:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609533696 00000100:00100000:3.0:1787432817.099953:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609533312 00000100:00100000:3.0:1787432817.099955:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609533312 00000100:00100000:3.0:1787432817.099965:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609533824 00000100:00100000:3.0:1787432817.099967:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609533824 00000100:00100000:3.0:1787432817.099982:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787432817.099990:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609533184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.100054:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609533184:12345-0@lo:400:kworker.0 Request processed in 64us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432817.100061:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787432817.100078:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787432817.100084:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609533696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.100111:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609533696:12345-0@lo:400:kworker.0 Request processed in 28us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432817.100117:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787432817.100128:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787432817.100134:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609533312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.100160:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609533312:12345-0@lo:400:kworker.0 Request processed in 27us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432817.100205:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787432817.100218:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787432817.100224:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609533824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.100253:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609533824:12345-0@lo:400:kworker.0 Request processed in 30us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432817.100259:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787432817.100281:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609534208 00000100:00100000:3.0:1787432817.100285:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609534208 00000100:00100000:3.0:1787432817.100330:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609534336 00000100:00100000:3.0:1787432817.100334:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609534336 00000100:00100000:3.0:1787432817.100358:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787432817.100365:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b3c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609534208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.100399:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b3c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609534208:12345-0@lo:400:kworker.0 Request processed in 35us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432817.100405:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787432817.100417:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787432817.100423:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609534336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.100452:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609534336:12345-0@lo:400:kworker.0 Request processed in 30us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432817.100457:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1787432817.100472:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432817.100476:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432817.100478:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432817.100480:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432817.100538:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843b3cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609533312:0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.100548:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843b3c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609533824:0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.100557:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843b3ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609534336:0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.100568:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843b3c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609533184:0@lo:400:kworker.0 00000100:00100000:3.0:1787432817.100576:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843b3c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609533696:0@lo:400:kworker.0 00010000:00080000:3.0:1787432817.100587:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843b3c9500 x1874258609534208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432817.100597:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843b3c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609534208:0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.100769:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843b3c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609533056:0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.100805:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432817.100846:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843b3cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609533568:0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.100868:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432817.100886:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843b3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609534080:0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.100905:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432817.100921:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609534592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432817.100943:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432817.100974:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787432817.100980:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843b3cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609532928:0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.101022:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432817.101046:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843b3c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609533440:0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.101073:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432817.101102:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843b3c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609533952:0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.101128:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432817.101141:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843b3ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609534464:0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.101196:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432817.101231:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609534080 00000100:00100000:2.0:1787432817.101237:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609534080 00000100:00100000:2.0:1787432817.101270:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609533440 00000100:00100000:2.0:1787432817.101274:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609533440 00000100:00100000:2.0:1787432817.101287:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609533952 00000100:00100000:2.0:1787432817.101289:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609533952 00000100:00100000:2.0:1787432817.101313:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609534464 00000100:00100000:2.0:1787432817.101316:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609534464 00000100:00100000:2.0:1787432817.101332:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787432817.101338:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609534080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.101378:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609534080:12345-0@lo:400:kworker.0 Request processed in 40us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432817.101384:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787432817.101398:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787432817.101404:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609533440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.101431:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609533440:12345-0@lo:400:kworker.0 Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432817.101437:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787432817.101457:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787432817.101463:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609533952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.101493:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609533952:12345-0@lo:400:kworker.0 Request processed in 31us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432817.101499:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787432817.101511:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787432817.101517:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609534464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.101541:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609534464:12345-0@lo:400:kworker.0 Request processed in 24us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432817.101547:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787432817.101575:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609533056 00000100:00100000:2.0:1787432817.101579:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609533056 00000100:00100000:2.0:1787432817.101603:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609533568 00000100:00100000:2.0:1787432817.101605:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609533568 00000100:00100000:2.0:1787432817.101616:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787432817.101621:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609533056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.101655:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609533056:12345-0@lo:400:kworker.0 Request processed in 33us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432817.101661:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787432817.101672:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787432817.101678:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609533568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.101703:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609533568:12345-0@lo:400:kworker.0 Request processed in 26us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432817.101708:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787432817.101725:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609534592 00000100:00100000:2.0:1787432817.101728:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609534592 00000100:00100000:2.0:1787432817.101751:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787432817.101765:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609534592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432817.101787:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787432817.101818:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609534592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432817.101824:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787432817.101844:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609532928 00000100:00100000:2.0:1787432817.101848:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609532928 00000100:00100000:2.0:1787432817.101873:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787432817.101878:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3642:x1874258609532928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.101906:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3642:x1874258609532928:12345-0@lo:400:kworker.0 Request processed in 28us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432817.101911:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:2.0:1787432817.101950:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432817.101954:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432817.101979:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843b3cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609532928:0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.101991:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843b3c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609533440:0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.102000:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843b3c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609533952:0@lo:400:kworker.0 00010000:00080000:2.0:1787432817.102010:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843b3ca680 x1874258609534464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432817.102020:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843b3ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609534464:0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.102030:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843b3c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609533056:0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.102038:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843b3cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609533568:0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.102047:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843b3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609534080:0@lo:400:kworker.0 00000100:00100000:2.0:1787432817.102071:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609534592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432817.104062:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432817.104086:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609534720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432817.104149:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432817.104220:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609534720 00000100:00100000:3.0:1787432817.104228:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609534720 00000100:00100000:3.0:1787432817.104279:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787432817.104290:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840356a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609534720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432817.104324:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787432817.104373:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840356a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609534720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432817.104380:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787432817.104432:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609534720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787432817.803396:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432818.123553:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432818.123579:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609534848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432818.123663:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432818.124032:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609534848 00000100:00100000:3.0:1787432818.124041:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609534848 00000100:00100000:3.0:1787432818.124100:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787432818.124113:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609534848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432818.124140:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787432818.124213:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609534848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432818.124220:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787432818.124578:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609534848:0@lo:13:osp-pre-0-0.0 00000020:01000004:2.0:1787432818.239369:0:20726:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787432818.257606:0:20726:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787432818.257664:0:20726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd47 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432818.257680:0:20726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fd47 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432818.257704:0:20726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fd47 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432818.257711:0:20726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fd47 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432818.257765:0:20726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787432818.257772:0:20726:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787432818.257799:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787432818.257804:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787432818.257810:0:20726:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787432818.257834:0:20726:0:(import.c:65:import_set_state_nolock()) ffff9484122e1800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787432818.258393:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609534976:0@lo:39:umount.0 00000100:00100000:0.0:1787432818.258475:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432818.258684:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609534976 00000100:00100000:1.0:1787432818.258692:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609534976 00000100:00100000:1.0:1787432818.258747:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787432818.258758:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874258609534976:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787432818.258786:0:17155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fd71 00000100:00080000:1.0:1787432818.258794:0:17155:0:(import.c:65:import_set_state_nolock()) ffff948434b72000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787432818.258920:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432818.258928:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fd47 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432818.258937:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432818.258941:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fd47 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432818.258951:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563fd47 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432818.258959:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563fd47 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432818.258965:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787432818.258967:0:17142:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787432818.258982:0:17142:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787432818.259010:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fd47 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432818.259016:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432818.259044:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fd47 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432818.259051:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fd47 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432818.259062:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432818.259074:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432818.259076:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432818.259192:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432818.259205:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609535104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787432818.259245:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432818.259374:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609535104 00000100:00100000:2.0:1787432818.259379:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609535104 00000100:00100000:2.0:1787432818.259420:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432818.259427:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840356aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3642:x1874258609535104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432818.259439:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432818.259454:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303850400/0xca72b3b33563fd47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563fd40 expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432818.259466:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432818.259508:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840356aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:3642:x1874258609535104:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432818.259516:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432818.259595:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609535104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432818.259790:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1874258609534976:12345-0@lo:39:umount.0 Request processed in 1034us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432818.259797:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1787432818.259804:0:17155:0:(genops.c:885:class_export_put()) final put ffff9484122e6800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787432818.259828:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9484122e6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787432818.259868:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948434b72000 for lustre-MDT0000 00000100:00080000:3.0:1787432818.259922:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484122e1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787432818.259938:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609534976:0@lo:39:umount.0 00000100:00080000:1.0:1787432818.260062:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787432818.260065:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787432818.260070:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787432818.261529:0:20726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc98 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.261544:0:20726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fc98 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.261551:0:20726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fc98 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.261558:0:20726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fc98 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432818.261680:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432818.261687:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fc98 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432818.261694:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432818.261699:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fc98 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432818.261707:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563fc98 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432818.261715:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563fc98 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432818.261720:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787432818.261723:0:17143:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787432818.261755:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fc98 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432818.261760:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787432818.261824:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609535232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787432818.261880:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432818.261967:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609535232 00000100:00100000:2.0:1787432818.261983:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609535232 00010000:00010000:1.0:1787432818.262198:0:20726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787432818.262213:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432818.262224:0:20726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356400ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262232:0:20726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b3356400ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262238:0:20726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b3356400ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262245:0:20726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b3356400ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262258:0:20726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432818.262264:0:20726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640241 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262269:0:20726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640241 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262288:0:20726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b335640241 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262294:0:20726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b335640241 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262305:0:20726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787432818.262319:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432818.262323:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b3356400ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262329:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e800 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432818.262332:0:19769:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b3356400ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262339:0:19769:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b3356400ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432818.262345:0:19769:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b3356400ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432818.262350:0:19769:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787432818.262352:0:19769:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787432818.262354:0:19769:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787432818.262374:0:19769:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b3356400ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262379:0:19769:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432818.262394:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b3356400ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262400:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b3356400ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262412:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432818.262415:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b335640241 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262429:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302690000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432818.262432:0:19769:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b335640241 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262438:0:19769:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b335640241 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432818.262443:0:19769:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b335640241 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432818.262447:0:19769:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787432818.262449:0:19769:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787432818.262451:0:19769:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787432818.262463:0:19769:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b335640241 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262468:0:19769:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432818.262474:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b335640241 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262479:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b335640241 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262487:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432818.262489:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432818.262490:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432818.262500:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609535360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432818.262532:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432818.262553:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432818.262565:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609535488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432818.262586:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787432818.262606:0:20726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262613:0:20726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fc8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262619:0:20726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fc8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262625:0:20726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fc8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262634:0:20726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787432818.262637:0:20726:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787432818.262640:0:20726:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1787432818.262669:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432818.262672:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fc8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262678:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432818.262681:0:19769:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fc8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262687:0:19769:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563fc8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432818.262692:0:19769:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563fc8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432818.262706:0:19769:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787432818.262708:0:19769:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787432818.262709:0:19769:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787432818.262722:0:19769:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fc8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.262727:0:19769:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787432818.262904:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609535360 00000100:00100000:2.0:1787432818.262909:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609535360 00000100:00100000:2.0:1787432818.262935:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609535488 00000100:00100000:2.0:1787432818.262938:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609535488 00000100:00100000:2.0:1787432818.262952:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432818.262961:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840356a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+25:3642:x1874258609535232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432818.262983:0:18685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432818.262996:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e5200/0xca72b3b33563fc98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563fc91 expref: 25 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432818.263006:0:18685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432818.263070:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fc98 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432818.263078:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fc98 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432818.263089:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432818.263091:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432818.263092:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432818.263111:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787432818.263119:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3643:x1874258609535360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432818.263128:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432818.263137:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94843f85f800/0xca72b3b3356400ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b3356400a4 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432818.263145:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432818.263193:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:3643:x1874258609535360:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432818.263200:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787432818.263220:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787432818.263227:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:3643:x1874258609535488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432818.263233:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432818.263241:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948301f05400/0xca72b3b335640241 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33564023a expref: 22 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432818.263249:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432818.263270:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:3643:x1874258609535488:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432818.263285:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787432818.263326:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609535488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432818.263336:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609535360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432818.263359:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609535616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432818.263383:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432818.263411:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609535616 00000100:00100000:0.0:1787432818.263414:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609535616 00000100:00100000:0.0:1787432818.263431:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787432818.263436:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:3641:x1874258609535616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432818.263443:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432818.263450:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303851000/0xca72b3b33563fc8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563fc83 expref: 21 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432818.263458:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432818.263479:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:3641:x1874258609535616:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432818.263485:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787432818.263504:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609535616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432818.263771:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fc8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.263780:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fc8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432818.263790:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432818.263791:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432818.263793:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787432818.263806:0:20726:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787432818.263811:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787432818.263815:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432818.263820:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1787432818.263825:0:20726:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9483039e5000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787432818.263831:0:20726:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9483027d2000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787432818.263836:0:20726:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff94843f86f000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787432818.263841:0:20726:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff948434886800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787432818.263848:0:20726:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff948304716000 9fd65f33-d046-43bb-9119-74a1dce1ebb4 192.168.204.24@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1787432818.263852:0:20726:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff948301e40000 17ee1936-2707-48b4-a113-f80e95ac94b4 192.168.204.24@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:1.0:1787432818.263857:0:20726:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9483031a8000) has exports, disconnecting them 00000020:00080000:1.0:1787432818.263867:0:20726:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9483039e5000), last request at 1787432817 00000020:00000080:1.0:1787432818.263873:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b335640073 00000100:00080000:1.0:1787432818.263899:0:20726:0:(import.c:65:import_set_state_nolock()) ffff9483039e7800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787432818.263947:0:20726:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9483039e5000): rc 0 00000020:00000080:1.0:1787432818.263950:0:20726:0:(genops.c:885:class_export_put()) final put ffff9483039e5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787432818.263958:0:20726:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9483027d2000), last request at 1787432817 00000020:00000080:1.0:1787432818.263961:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ff0e 00000100:00080000:1.0:1787432818.264048:0:20726:0:(import.c:65:import_set_state_nolock()) ffff9483027d2800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787432818.264061:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787432818.264068:0:20726:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9483027d2000): rc 0 00000020:00000080:1.0:1787432818.264070:0:20726:0:(genops.c:885:class_export_put()) final put ffff9483027d2000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1787432818.264075:0:20726:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94843f86f000), last request at 1787432737 00000020:00000080:1.0:1787432818.264078:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fe5f 00000100:00080000:1.0:1787432818.264081:0:20726:0:(import.c:65:import_set_state_nolock()) ffff94843f86c000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787432818.264088:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787432818.264092:0:20726:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94843f86f000): rc 0 00000020:00000080:1.0:1787432818.264094:0:20726:0:(genops.c:885:class_export_put()) final put ffff94843f86f000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1787432818.264097:0:20726:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff948434886800), last request at 1787432737 00000020:00000080:1.0:1787432818.264100:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fdf6 00000100:00080000:1.0:1787432818.264102:0:20726:0:(import.c:65:import_set_state_nolock()) ffff948410647800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787432818.264108:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787432818.264113:0:20726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000001:00100000:1.0:1787432818.265370:0:17134:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9fd65f33-d046-43bb-9119-74a1dce1ebb4 00000001:00080000:1.0:1787432818.265382:0:17134:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:1.0:1787432818.265386:0:17134:0:(genops.c:885:class_export_put()) final put ffff948304716000/9fd65f33-d046-43bb-9119-74a1dce1ebb4 00000001:00100000:1.0:1787432818.265393:0:17134:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 17ee1936-2707-48b4-a113-f80e95ac94b4 00000001:00080000:1.0:1787432818.265401:0:17134:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:1.0:1787432818.265407:0:17134:0:(genops.c:885:class_export_put()) final put ffff948301e40000/17ee1936-2707-48b4-a113-f80e95ac94b4 00000020:00080000:1.0:1787432818.265496:0:20726:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff948434886800): rc 0 00000004:00000080:1.0:1787432818.265504:0:20726:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb0c1c7b0fae0 00000100:00080000:1.0:1787432818.265523:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787432818.265526:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1787432818.266021:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840356a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:3642:x1874258609535232:12345-0@lo:103:ldlm_bl.0 Request processed in 3058us (4137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432818.266033:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787432818.266119:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787432818.266261:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9483039e5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787432818.266320:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9483027d2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787432818.266341:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94843f86f000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787432818.266358:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948304716000/9fd65f33-d046-43bb-9119-74a1dce1ebb4 for lustre-MDT0000 00000020:00000080:0.0:1787432818.266385:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948301e40000/17ee1936-2707-48b4-a113-f80e95ac94b4 for lustre-MDT0000 00000020:00000080:0.0:1787432818.266412:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9483039e7800 for lustre-MDT0000 00000020:00000080:0.0:1787432818.266416:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9483027d2800 for lustre-MDT0000 00000020:00000080:0.0:1787432818.266420:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843f86c000 for lustre-MDT0000 00000020:00000080:0.0:1787432818.266436:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948304712000 for lustre-MDT0000 00000020:00000080:0.0:1787432818.266439:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94842d4c1800 for lustre-MDT0000 00010000:00010000:0.0:1787432818.266450:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432818.267453:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609535232:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787432818.267519:0:20726:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787432818.267546:0:20726:0:(import.c:65:import_set_state_nolock()) ffff948409d2f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787432818.267594:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609535744:0@lo:39:umount.0 00000100:00100000:3.0:1787432818.267656:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432818.267725:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609535744 00000100:00100000:2.0:1787432818.267731:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609535744 00000100:00100000:2.0:1787432818.267785:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787432818.267795:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840356b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874258609535744:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787432818.267820:0:17159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fe89 00000100:00080000:2.0:1787432818.267827:0:17159:0:(import.c:65:import_set_state_nolock()) ffff948434d98800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432818.267846:0:17159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:0.0:1787432818.268233:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787432818.268238:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1787432818.268250:0:20726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787432818.268321:0:20726:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787432818.268333:0:20726:0:(import.c:65:import_set_state_nolock()) ffff9484166d0800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787432818.268385:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432818.268477:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609535872:0@lo:9:umount.0 00000100:00100000:3.0:1787432818.268510:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432818.268590:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840356b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3640:x1874258609535744:12345-0@lo:39:umount.0 Request processed in 796us (933us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787432818.268599:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000001:00100000:2.0:1787432818.269711:0:17886:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787432818.269722:0:17886:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1787432818.269726:0:17886:0:(genops.c:885:class_export_put()) final put ffff94843f86d800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787432818.269752:0:17886:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9fd65f33-d046-43bb-9119-74a1dce1ebb4 00000001:00080000:2.0:1787432818.269756:0:17886:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1787432818.269758:0:17886:0:(genops.c:885:class_export_put()) final put ffff948304712800/9fd65f33-d046-43bb-9119-74a1dce1ebb4 00000001:00100000:2.0:1787432818.269763:0:17886:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 17ee1936-2707-48b4-a113-f80e95ac94b4 00000001:00080000:2.0:1787432818.269766:0:17886:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1787432818.269768:0:17886:0:(genops.c:885:class_export_put()) final put ffff94842d4c1000/17ee1936-2707-48b4-a113-f80e95ac94b4 00000020:00000080:1.0:1787432818.269808:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843f86d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1787432818.269868:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948304712800/9fd65f33-d046-43bb-9119-74a1dce1ebb4 for lustre-MDT0001 00000020:00000080:1.0:1787432818.269892:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94842d4c1000/17ee1936-2707-48b4-a113-f80e95ac94b4 for lustre-MDT0001 00000020:00000080:1.0:1787432818.269912:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948434d98800 for lustre-MDT0001 00000020:00000080:1.0:1787432818.269917:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948304714000 for lustre-MDT0001 00000020:00000080:1.0:1787432818.269920:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94842d4c3800 for lustre-MDT0001 00000100:00080000:0.0:1787432818.270059:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787432818.270063:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1787432818.270082:0:20726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787432818.270141:0:20726:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787432818.270283:0:20726:0:(import.c:65:import_set_state_nolock()) ffff9484034a6800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787432818.270333:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9483031a8000) has no exports 00000100:00080000:3.0:1787432818.270864:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948409d2f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787432818.270873:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609535744:0@lo:39:umount.0 00000100:00100000:3.0:1787432818.270893:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609536000:0@lo:9:umount.0 00000100:00100000:3.0:1787432818.270948:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432818.271054:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609535872 00000100:00100000:0.0:1787432818.271061:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609535872 00000100:00100000:0.0:1787432818.271104:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609536000 00000100:00100000:0.0:1787432818.271107:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609536000 00000100:00100000:0.0:1787432818.271128:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787432818.271138:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874258609535872:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787432818.271192:0:19127:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ff54 00000100:00080000:0.0:1787432818.271201:0:19127:0:(import.c:65:import_set_state_nolock()) ffff948301e02800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787432818.271236:0:19127:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787432818.271427:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787432818.271439:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840356ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874258609536000:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787432818.271453:0:18660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b3356400b2 00000100:00080000:2.0:1787432818.271459:0:18660:0:(import.c:65:import_set_state_nolock()) ffff9483039e0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432818.271488:0:18660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787432818.271675:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3640:x1874258609535872:12345-0@lo:9:umount.0 Request processed in 537us (3163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432818.271682:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787432818.271761:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484166d0800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787432818.271780:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787432818.271783:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787432818.271785:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609535872:0@lo:9:umount.0 00000100:00100000:2.0:1787432818.271938:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840356ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3640:x1874258609536000:12345-0@lo:9:umount.0 Request processed in 503us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432818.271944:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1787432818.272108:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432818.272114:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787432818.273071:0:19475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787432818.273076:0:19475:0:(genops.c:885:class_export_put()) final put ffff9483039e0800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787432818.273098:0:19475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 17ee1936-2707-48b4-a113-f80e95ac94b4 00000020:00000080:2.0:1787432818.273100:0:19475:0:(genops.c:885:class_export_put()) final put ffff94842d4c2800/17ee1936-2707-48b4-a113-f80e95ac94b4 00000020:00000080:0.0:1787432818.273142:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9483039e0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787432818.273213:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94842d4c2800/17ee1936-2707-48b4-a113-f80e95ac94b4 for lustre-OST0001 00000020:00000080:0.0:1787432818.273235:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9483039e0000 for lustre-OST0001 00000020:00000080:0.0:1787432818.273238:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94842d4c2000 for lustre-OST0001 00000100:00080000:3.0:1787432818.273450:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484034a6800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787432818.273494:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787432818.273578:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787432818.273583:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609536000:0@lo:9:umount.0 00000020:00080000:2.0:1787432818.287718:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9483031a8000) has no exports 00000020:00000080:2.0:1787432818.350460:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fcde 00000020:00000080:2.0:1787432818.350477:0:20726:0:(genops.c:885:class_export_put()) final put ffff9484166d0000/lustre-QMT0000_UUID 00000020:01000000:2.0:1787432818.350554:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787432818.350655:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787432818.350664:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787432818.350668:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9484349d3370) has no exports 00000020:00000080:3.0:1787432818.351302:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fcd7 00000020:00000080:3.0:1787432818.351316:0:20726:0:(genops.c:885:class_export_put()) final put ffff94842ebc1000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787432818.352033:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9484166d0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787432818.352528:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432818.352539:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787432818.352543:0:20726:0:(genops.c:885:class_export_put()) final put ffff94842ebc6800/lustre-QMT0000_UUID 00000020:00000080:3.0:1787432818.352546:0:20726:0:(genops.c:844:class_export_destroy()) destroying export ffff94842ebc6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787432818.352554:0:20726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787432818.352820:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94842ebc1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1787432818.827865:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432819.147706:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432819.147729:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609536128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432819.147804:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432819.147928:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609536128 00000100:00100000:2.0:1787432819.147937:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609536128 00000100:00100000:2.0:1787432819.147991:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787432819.148000:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1874258609536128:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1787432819.148007:0:17160:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787432819.148053:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1874258609536128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (248us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787432819.148060:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:02020000:2.0:1787432819.148100:0:3641:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:1.0:1787432819.150053:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432819.150078:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609536256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432819.150139:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432819.151098:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609536256 00000100:00100000:3.0:1787432819.151108:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609536256 00000100:00100000:3.0:1787432819.152128:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787432819.152156:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609536256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787432819.152202:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787432819.152285:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609536256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 146us (2145us total) trans 0 rc 0/0 00000100:00080000:1.0:1787432819.152348:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432819.152389:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609536256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432819.160844:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787432819.161436:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787432819.161443:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9483039ef800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787432819.161447:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787432819.210541:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9483039ef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432819.210564:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 548 00000100:00080000:2.0:1787432819.210575:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9483039ef800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432819.210617:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94843f921c00 x1874258609536384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432819.212305:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609536384:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787432819.212400:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432819.212997:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609536384 00000100:00100000:2.0:1787432819.213006:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609536384 00000100:00100000:2.0:1787432819.213055:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787432819.213064:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840356b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874258609536384:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1787432819.213084:0:17159:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787432819.229915:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840356b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874258609536384:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 16840us (17504us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787432819.229931:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1787432819.230473:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9483039ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432819.230480:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787432819.230484:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609536384:0@lo:38:ptlrpcd_00_00.0 00000040:00080000:0.0:1787432819.276049:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787432819.851606:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432820.875749:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432821.899553:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432822.219694:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432822.219719:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609536512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432822.219788:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787432822.220241:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787432822.220246:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787432822.220250:0:36:0:(import.c:65:import_set_state_nolock()) ffff9483039ef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787432822.220257:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 630 00000100:00080000:1.0:1787432822.220264:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787432822.220271:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9483039ef800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432822.220298:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9483039b4700 x1874258609536768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787432822.220421:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609536896:0@lo:400:kworker.0 00000100:00100000:1.0:1787432822.220463:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432822.220485:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609537408:0@lo:400:kworker.0 00000100:00100000:1.0:1787432822.220512:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432822.220533:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787432822.220539:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609536640:0@lo:400:kworker.0 00000100:00100000:1.0:1787432822.220569:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432822.220605:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609537280:0@lo:400:kworker.0 00000100:00100000:1.0:1787432822.220627:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432822.220656:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609536640 00000100:00100000:1.0:1787432822.220663:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609536640 00000100:00100000:1.0:1787432822.220710:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787432822.220718:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:3642:x1874258609536640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432822.220773:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:3642:x1874258609536640:12345-0@lo:400:kworker.0 Request processed in 54us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432822.220780:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787432822.220826:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609536640:0@lo:400:kworker.0 00000100:00100000:2.0:1787432822.221296:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609537408 00000100:00100000:2.0:1787432822.221302:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609537408 00000100:00100000:2.0:1787432822.221348:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609537280 00000100:00100000:2.0:1787432822.221351:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609537280 00000100:00100000:2.0:1787432822.221396:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787432822.221406:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609537280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432822.221455:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609537280:12345-0@lo:400:kworker.0 Request processed in 52us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432822.221461:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787432822.221481:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787432822.221485:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1874258609537408:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787432822.221491:0:17154:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787432822.221517:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1874258609537408:12345-0@lo:400:kworker.0 Request processed in 30us (1005us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787432822.221522:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787432822.221547:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787432822.221564:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609537152:0@lo:400:kworker.0 00000100:00100000:2.0:1787432822.221603:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432822.221625:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787432822.221631:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609537024:0@lo:400:kworker.0 00000100:00100000:2.0:1787432822.221664:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432822.221681:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609537536:0@lo:400:kworker.0 00000100:00100000:2.0:1787432822.221700:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432822.221722:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609537152 00000100:00100000:2.0:1787432822.221725:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609537152 00000100:00100000:2.0:1787432822.221739:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609537024 00000100:00100000:2.0:1787432822.221742:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609537024 00000100:00100000:2.0:1787432822.221748:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609537536 00000100:00100000:2.0:1787432822.221750:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609537536 00000100:00100000:2.0:1787432822.221771:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787432822.221777:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609537536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432822.221809:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609537536:12345-0@lo:400:kworker.0 Request processed in 32us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432822.221815:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787432822.221827:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787432822.221831:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1874258609537152:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787432822.221835:0:17155:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787432822.221856:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1874258609537152:12345-0@lo:400:kworker.0 Request processed in 24us (252us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787432822.221861:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787432822.221873:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787432822.221876:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1874258609537024:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787432822.221881:0:17155:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787432822.222443:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609536768:0@lo:38:kworker.0 00000100:00100000:0.0:1787432822.222488:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432822.222526:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609536768 00000100:00100000:0.0:1787432822.222531:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609536768 00000100:00100000:0.0:1787432822.222554:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787432822.222559:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1874258609536768:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1787432822.222587:0:17894:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787432822.223333:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1874258609537024:12345-0@lo:400:kworker.0 Request processed in 37us (249us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787432822.223346:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787432822.224151:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609536512 00000100:00100000:3.0:1787432822.224162:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609536512 00000100:00100000:3.0:1787432822.224259:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787432822.224269:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609536512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787432822.224306:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787432822.224405:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609536512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (4616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432822.224412:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1787432822.224506:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948409d25180 x1874258609537280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432822.224522:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609537280:0@lo:400:kworker.0 00000100:00080000:3.0:1787432822.224538:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787432822.224543:0:3642:0:(import.c:65:import_set_state_nolock()) ffff94830347d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787432822.224548:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787432822.224554:0:3642:0:(import.c:65:import_set_state_nolock()) ffff94830347d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432822.224558:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 581 00000100:00080000:3.0:1787432822.224563:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94830347d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432822.224591:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948403568380 x1874258609537664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432822.224631:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609537408:0@lo:400:kworker.0 00000100:00080000:3.0:1787432822.224670:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432822.224675:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432822.224701:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787432822.224704:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94843f83d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787432822.224707:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787432822.224710:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94843f83d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432822.224713:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 548 00000100:00080000:3.0:1787432822.224717:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94843f83d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432822.224731:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94840356bb80 x1874258609537792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432822.224741:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609537024:0@lo:400:kworker.0 00010000:00080000:3.0:1787432822.224755:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359e9c00 x1874258609537536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432822.224764:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609537536:0@lo:400:kworker.0 00000100:00080000:3.0:1787432822.224777:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787432822.224779:0:3644:0:(import.c:65:import_set_state_nolock()) ffff948301d56000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787432822.224782:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787432822.224786:0:3644:0:(import.c:65:import_set_state_nolock()) ffff948301d56000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432822.224789:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 564 00000100:00080000:3.0:1787432822.224793:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff948301d56000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432822.224805:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948403568e00 x1874258609537920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432822.224822:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609537152:0@lo:400:kworker.0 00000100:00100000:3.0:1787432822.224873:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609536896 00000100:00100000:3.0:1787432822.224877:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609536896 00000100:00100000:3.0:1787432822.224931:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787432822.224941:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609536896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432822.224983:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609536896:12345-0@lo:400:kworker.0 Request processed in 45us (4519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432822.224990:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787432822.225007:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432822.225026:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609536896:0@lo:400:kworker.0 00000100:00100000:3.0:1787432822.225077:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609536512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432822.225537:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609537664:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787432822.225594:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432822.225625:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874258609537792:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787432822.225647:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432822.225667:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609537920:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787432822.225686:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432822.225727:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609537664 00000100:00100000:1.0:1787432822.225732:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609537664 00000100:00100000:1.0:1787432822.225749:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609537792 00000100:00100000:1.0:1787432822.225751:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609537792 00000100:00100000:1.0:1787432822.225759:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609537920 00000100:00100000:1.0:1787432822.225760:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609537920 00000100:00100000:1.0:1787432822.225770:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787432822.225775:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874258609537664:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1787432822.225790:0:17156:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787432822.225824:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874258609537664:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 48us (230us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787432822.225830:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787432822.225841:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787432822.225844:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874258609537792:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1787432822.225850:0:17156:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787432822.225867:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874258609537792:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 22us (220us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787432822.225871:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787432822.225879:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787432822.225882:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874258609537920:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1787432822.225887:0:17156:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787432822.225903:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874258609537920:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 19us (216us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787432822.225907:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1787432822.225953:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94830347d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432822.225958:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787432822.225962:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609537664:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1787432822.225970:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843f83d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432822.225980:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787432822.225983:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874258609537792:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1787432822.225992:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948301d56000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432822.225995:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787432822.225998:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609537920:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787432822.243646:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1874258609536768:12345-0@lo:38:kworker.0 Request processed in 21076us (21149us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787432822.243664:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1787432822.243860:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9483039ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787432822.243884:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787432822.243888:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609536768:0@lo:38:kworker.0 00010000:00010000:2.0:1787432822.923370:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787432823.761797:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787432823.761806:0:18655:0:(genops.c:885:class_export_put()) final put ffff948301e05000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787432823.761883:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948301e05000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787432823.761938:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948301e02800 for lustre-OST0000 00000001:00100000:0.0:1787432823.763301:0:17134:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787432823.763309:0:17134:0:(genops.c:885:class_export_put()) final put ffff948434886800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787432823.763410:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948434886800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787432823.763468:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948410647800 for lustre-MDT0000 00010000:00010000:2.0:1787432823.953993:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432824.267691:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432824.271657:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609538048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432824.271778:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432824.271961:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609538048 00000100:00100000:3.0:1787432824.271984:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609538048 00000100:00100000:3.0:1787432824.272058:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787432824.272068:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609538048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787432824.272103:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787432824.272191:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609538048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432824.272199:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787432824.272783:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609538048:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787432824.272903:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:3.0:1787432824.395542:0:20726:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948301e21180 - data ffff9484073e8bd0/ffff94842d490800 00000020:01000000:3.0:1787432824.395713:0:20726:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948303b074e0 - data ffff94842e0155e8/ffff94843daa5000 00000001:00000004:3.0:1787432824.403921:0:20726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:2.0:1787432824.468976:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787432824.468988:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787432824.469007:0:20726:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff948303a38000 x1874258609535744/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787432828 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432824.469035:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787432824.473835:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787432824.473857:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787432824.473976:0:20726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787432824.473981:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787432824.476934:0:17178:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787432824.476942:0:17178:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1787432824.476954:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1787432824.477726:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787432824.477732:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1787432824.477753:0:20726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787432824.477756:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787432824.478054:0:17180:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787432824.478058:0:17180:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:2.0:1787432824.478068:0:17180:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1787432824.480385:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fca6 00000020:00000080:0.0:1787432824.480398:0:20726:0:(genops.c:885:class_export_put()) final put ffff948301dc4000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787432824.480674:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dc4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787432824.484741:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fcbb 00000020:00000080:2.0:1787432824.484756:0:20726:0:(genops.c:885:class_export_put()) final put ffff948301dc3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787432824.484778:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787432824.484783:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432824.484792:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787432824.484795:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9483031ab370) has no exports 00000004:01000000:2.0:1787432824.485124:0:20726:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787432824.485133:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fd1d 00000020:00000080:2.0:1787432824.485138:0:20726:0:(genops.c:885:class_export_put()) final put ffff94842ebc2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787432824.485251:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787432824.485256:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432824.485261:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787432824.485264:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff94841de9b370) has no exports 00000020:00000080:2.0:1787432824.485270:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fd16 00000020:00000080:2.0:1787432824.485275:0:20726:0:(genops.c:885:class_export_put()) final put ffff9484034a7800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787432824.485698:0:20726:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787432824.485704:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787432824.485708:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1787432824.485713:0:20726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787432824.485716:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787432824.485745:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432824.485750:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787432824.485755:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fd08 00000020:00000080:2.0:1787432824.485759:0:20726:0:(genops.c:885:class_export_put()) final put ffff94842ebc0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787432824.485763:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787432824.485766:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432824.485768:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787432824.485771:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9484349d4d28) has no exports 00000020:00000080:2.0:1787432824.485774:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fd01 00000020:00000080:2.0:1787432824.485777:0:20726:0:(genops.c:885:class_export_put()) final put ffff94842ebc4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787432824.485977:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dc3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787432824.485987:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94842ebc2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787432824.485991:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9484034a7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787432824.485995:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9484034a6800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787432824.486001:0:8:0:(genops.c:885:class_export_put()) final put ffff94842ebc6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787432824.486003:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94842ebc6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787432824.486007:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787432824.486089:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94842ebc0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787432824.486095:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94842ebc4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787432824.487683:0:20726:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787432824.487692:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787432824.487697:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1787432824.487706:0:20726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787432824.487708:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787432824.487805:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432824.487814:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1787432824.487830:0:20726:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787432824.487837:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fcf3 00000020:00000080:2.0:1787432824.487916:0:20726:0:(genops.c:885:class_export_put()) final put ffff94842ebc1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787432824.491318:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9484166d0800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787432824.491341:0:8:0:(genops.c:885:class_export_put()) final put ffff94842ebc5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787432824.491345:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94842ebc5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787432824.491356:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787432824.491996:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1787432824.492032:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432824.492042:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787432824.492047:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9483030f19b8) has no exports 00000020:00000080:2.0:1787432824.492054:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fcec 00000020:00000080:2.0:1787432824.492062:0:20726:0:(genops.c:885:class_export_put()) final put ffff9484166d7000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787432824.492299:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94842ebc1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787432824.499285:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9484166d7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787432824.583356:0:20726:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787432824.583368:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787432824.583373:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787432824.583382:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787432824.583432:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432824.583443:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787432824.583473:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432824.583476:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787432824.583482:0:20726:0:(genops.c:885:class_export_put()) final put ffff948301dc1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787432824.583486:0:20726:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dc1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787432824.583499:0:20726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787432824.583605:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fcc2 00000020:00000080:2.0:1787432824.583612:0:20726:0:(genops.c:885:class_export_put()) final put ffff948301dc3800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787432824.583617:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787432824.583621:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432824.583626:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787432824.583629:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9483031acd28) has no exports 00000020:00000080:2.0:1787432824.583651:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432824.583654:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787432824.583658:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fcc9 00000020:00000080:2.0:1787432824.583661:0:20726:0:(genops.c:885:class_export_put()) final put ffff948301dc0800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787432824.583669:0:20726:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9483038e1000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787432824.583673:0:20726:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9483038e1000 3 00000020:01000004:2.0:1787432824.583676:0:20726:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9483038e1000 from lustre-MDT0000 00000020:00000080:2.0:1787432824.583693:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432824.583696:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787432824.583699:0:20726:0:(genops.c:885:class_export_put()) final put ffff948301dc4800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787432824.583712:0:20726:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dc4800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787432824.583719:0:20726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787432824.583752:0:20726:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787432824.583756:0:20726:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787432824.583759:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787432824.583762:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432824.583764:0:20726:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787432824.583770:0:20726:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff94843c5ea800 a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787432824.583775:0:20726:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9483031a99b8) has exports, disconnecting them 00000020:00080000:2.0:1787432824.583779:0:20726:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff94843c5ea800), last request at 1787432721 00000020:00000080:2.0:1787432824.583794:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fc6e 00000020:00010000:2.0:1787432824.583798:0:20726:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94843c5ea800: total 2 00000100:00080000:2.0:1787432824.583802:0:20726:0:(import.c:65:import_set_state_nolock()) ffff94843c5ee000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787432824.583832:0:20726:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94843c5ea800): rc 0 00000020:00080000:2.0:1787432824.583835:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9483031a99b8) has no exports 00000100:00100000:2.0:1787432824.583913:0:17147:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff94840803b600:17147] 0 exiting: rc = 1 00000020:00000080:0.0:1787432824.583945:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948409d2f000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787432824.583955:0:8:0:(genops.c:885:class_export_put()) final put ffff9484166d2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787432824.583958:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9484166d2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1787432824.583968:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787432824.584029:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dc3800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787432824.584034:0:8:0:(genops.c:885:class_export_put()) final put ffff948301dc7800/lustre-MDD0000_UUID 00000020:00000080:0.0:1787432824.584036:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dc7800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787432824.584040:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787432824.584064:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dc0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1787432824.584117:0:19769:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94843c5ea800: total 0 00010000:00010000:1.0:1787432824.584121:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432824.584190:0:19769:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94843c5ea800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787432824.584222:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948304489e00/0xca72b3b33563fef9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563fef2 expref: 14 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432824.584242:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948302690e00/0xca72b3b335640225 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33564021e expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432824.584253:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e4c00/0xca72b3b33563fe4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563fe43 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432824.584263:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9483039f0000/0xca72b3b33563fd9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563fd94 expref: 11 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432824.584276:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303851e00/0xca72b3b33563fc7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563fc75 expref: 10 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432824.584286:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948302691a00/0xca72b3b335640217 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b335640210 expref: 9 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432824.584304:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9483039f1c00/0xca72b3b33563fd8d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563fd86 expref: 8 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432824.584319:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303850e00/0xca72b3b335640034 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33564002d expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432824.584330:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948302690c00/0xca72b3b335640233 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33564022c expref: 6 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432824.584349:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9483039f1000/0xca72b3b33563fda9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563fda2 expref: 5 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432824.584366:0:17148:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff948406c94800:17148] 1 exiting: rc = 0 00010000:00010000:1.0:1787432824.584366:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303851800/0xca72b3b33564005e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b335640057 expref: 4 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432824.584388:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e5800/0xca72b3b33564009d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b335640096 expref: 3 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432824.584402:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948304489800/0xca72b3b33563fecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563fec8 expref: 2 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432824.584416:0:19769:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94843c5ea800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1787432824.584432:0:19769:0:(genops.c:885:class_export_put()) final put ffff94843c5ea800/a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b 00010000:00010000:1.0:1787432824.584444:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432824.584446:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432824.584448:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432824.584478:0:17149:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff948406c94a00:17149] 2 exiting: rc = 0 00000020:00000080:0.0:1787432824.584574:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94843c5ea800/a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b for MGS 00000020:00000080:0.0:1787432824.584607:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843c5ee000 for MGS 00000100:00100000:2.0:1787432824.584913:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.584922:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.584929:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.584935:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.584941:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.584946:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.584951:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.584958:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.584964:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.584969:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.584975:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.584981:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585322:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585330:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585337:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585357:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585366:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585375:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585383:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585391:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585399:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585407:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585415:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585422:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585430:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585437:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585446:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585453:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585461:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585469:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585476:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585485:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585492:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585500:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585509:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585520:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585530:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585539:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585544:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585554:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585562:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585568:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585574:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585582:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585588:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585596:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585602:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585607:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585612:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585617:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585632:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585637:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585642:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585647:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585652:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585658:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585662:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585668:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585673:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585678:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585684:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585689:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585695:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432824.585700:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1787432824.588835:0:20726:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948301e21300 - data ffff9484073e8af8/ffff94842d491400 00000020:01000000:2.0:1787432824.588975:0:20726:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948303b07540 - data ffff94842e2dd438/ffff948435e7f400 00000020:00000080:2.0:1787432824.589703:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fc52 00000020:00000080:2.0:1787432824.589712:0:20726:0:(genops.c:885:class_export_put()) final put ffff94830470f000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787432824.589826:0:20726:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9483038e1000 from MGS, refs=2 00000020:01000004:2.0:1787432824.589831:0:20726:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9483038e1000 2 00000020:01000004:2.0:1787432824.589834:0:20726:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9483038e1000 from MGS 00000020:00000080:2.0:1787432824.589860:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432824.589867:0:20726:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787432824.589870:0:20726:0:(genops.c:885:class_export_put()) final put ffff94830470f800/MGS 00000020:00000080:2.0:1787432824.589874:0:20726:0:(genops.c:844:class_export_destroy()) destroying export ffff94830470f800/MGS for MGS 00000020:01000000:2.0:1787432824.589881:0:20726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787432824.589959:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787432824.589963:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432824.589968:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787432824.589976:0:20726:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9483036e8000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787432824.589982:0:20726:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff94841de9cd28) has exports, disconnecting them 00000020:00080000:2.0:1787432824.589988:0:20726:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9483036e8000), last request at 1787432722 00000020:00000080:2.0:1787432824.589992:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fd55 00000020:00080000:2.0:1787432824.590016:0:20726:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9483036e8000): rc 0 00000020:00000080:2.0:1787432824.590020:0:20726:0:(genops.c:885:class_export_put()) final put ffff9483036e8000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787432824.591962:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94830470f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787432824.593789:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9483036e8000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787432824.601322:0:20726:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787432824.601337:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787432824.601342:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787432824.601354:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787432824.601423:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9484122e1800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787432824.601750:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432824.601760:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787432824.601767:0:20726:0:(genops.c:885:class_export_put()) final put ffff94842ebc7000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787432824.601770:0:20726:0:(genops.c:844:class_export_destroy()) destroying export ffff94842ebc7000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787432824.601800:0:20726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787432824.601932:0:20726:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9483038e1000 1 00000020:00000080:1.0:1787432824.601939:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fc44 00000020:00000080:1.0:1787432824.601946:0:20726:0:(genops.c:885:class_export_put()) final put ffff94830470b000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787432824.601980:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787432824.601994:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432824.601999:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787432824.602002:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9484336199b8) has no exports 00000020:00000080:0.0:1787432824.602102:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94830470b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787432824.891025:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432824.891039:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787432824.891044:0:20726:0:(genops.c:885:class_export_put()) final put ffff9483038e5800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787432824.891050:0:20726:0:(genops.c:844:class_export_destroy()) destroying export ffff9483038e5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787432824.891061:0:20726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787432824.891464:0:20726:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9483038e4000 00000020:02000400:1.0:1787432824.891524:0:20726:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787432824.976665:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432825.996331:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432827.021354:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432827.343764:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609538176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432827.344265:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432827.344346:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609538176 00000100:00100000:3.0:1787432827.344353:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609538176 00000100:00100000:3.0:1787432827.344408:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787432827.344417:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609538176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787432827.344448:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787432827.344489:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609538176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432827.344495:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787432827.344514:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432827.344546:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609538176:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787432827.345384:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432827.345389:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787432827.345392:0:36:0:(import.c:65:import_set_state_nolock()) ffff9483039ef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432827.345399:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 633 00000100:00080000:0.0:1787432827.345404:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787432827.345409:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9483039ef800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432827.345433:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948434899180 x1874258609538432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432827.345468:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432827.345472:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787432827.345474:0:36:0:(import.c:65:import_set_state_nolock()) ffff94843f83d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432827.345478:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 633 00000100:00080000:0.0:1787432827.345481:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787432827.345485:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94843f83d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432827.345508:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94843489a300 x1874258609538688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432827.345517:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432827.345521:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787432827.345522:0:36:0:(import.c:65:import_set_state_nolock()) ffff948301d56000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432827.345525:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 633 00000100:00080000:0.0:1787432827.345527:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787432827.345531:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff948301d56000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432827.345542:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94843489a680 x1874258609538816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787432827.345786:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609538432:0@lo:38:kworker.0 00000100:00100000:2.0:1787432827.345837:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432827.345866:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874258609538688:0@lo:38:kworker.0 00000100:00100000:2.0:1787432827.345890:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432827.345929:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609538560:0@lo:400:kworker.0 00000100:00100000:2.0:1787432827.345956:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432827.346535:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609538688 00000100:00100000:1.0:1787432827.346543:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609538688 00000100:00100000:1.0:1787432827.346653:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787432827.346661:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874258609538688:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787432827.346681:0:17156:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787432827.348013:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609538432 00000100:00100000:3.0:1787432827.348021:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609538432 00000100:00100000:0.0:1787432827.348027:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609538816:0@lo:38:kworker.0 00000100:00100000:3.0:1787432827.348059:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787432827.348068:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609538432:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787432827.348088:0:17160:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787432827.348094:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432827.348156:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609538432:12345-0@lo:38:kworker.0 Request processed in 88us (2317us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787432827.348182:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1787432827.348188:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9483039ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432827.348195:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787432827.348199:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609538432:0@lo:38:kworker.0 00000100:00100000:3.0:1787432827.348208:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609538304:0@lo:400:kworker.0 00000100:00100000:0.0:1787432827.348231:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609538816 00000400:00000100:3.0:1787432827.348233:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874258609538304 offset 0 length 224: 4 00000100:00100000:0.0:1787432827.348236:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609538816 00000100:00100000:0.0:1787432827.348268:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787432827.348274:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874258609538816:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787432827.348285:0:17155:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787432827.348319:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874258609538816:12345-0@lo:38:kworker.0 Request processed in 44us (226us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787432827.348325:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1787432827.348349:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948301d56000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432827.348353:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787432827.348373:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609538816:0@lo:38:kworker.0 00000100:00080000:0.0:1787432827.348407:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432827.348411:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787432827.348413:0:36:0:(import.c:65:import_set_state_nolock()) ffff94830347d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432827.348417:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 633 00000100:00080000:0.0:1787432827.348422:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787432827.348427:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94830347d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432827.348438:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432827.348446:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609538944:0@lo:400:kworker.0 00000100:00100000:0.0:1787432827.348470:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432827.348522:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94843489b480 x1874258609539072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432827.348556:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609539072:0@lo:38:kworker.0 00000100:00100000:0.0:1787432827.348580:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432827.348593:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609538944 00000100:00100000:3.0:1787432827.348598:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609538944 00000100:00100000:0.0:1787432827.348610:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609539072 00000100:00100000:0.0:1787432827.348615:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609539072 00000100:00100000:0.0:1787432827.348636:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787432827.348641:0:20092:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787432827.348646:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609538944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432827.348651:0:20092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1787432827.348691:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609538944:12345-0@lo:400:kworker.0 Request processed in 48us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432827.348698:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787432827.348711:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787432827.348716:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874258609539072:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787432827.348727:0:17155:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787432827.348758:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874258609539072:12345-0@lo:38:kworker.0 Request processed in 39us (176us total) trans 0 rc -19/-19 00000100:00080000:3.0:1787432827.348768:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432827.348772:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1787432827.348802:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff94843489a680 x1874258609538944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432827.348814:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609538944:0@lo:400:kworker.0 00000100:00080000:0.0:1787432827.348834:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94830347d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432827.348837:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787432827.348840:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609539072:0@lo:38:kworker.0 00000100:00100000:0.0:1787432827.348873:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432827.348880:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609539200:0@lo:400:kworker.0 00000100:00100000:0.0:1787432827.348903:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432827.348924:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609539200 00000100:00100000:0.0:1787432827.348928:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609539200 00000100:00100000:0.0:1787432827.348953:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787432827.348959:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609539200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432827.348992:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609539200:12345-0@lo:400:kworker.0 Request processed in 32us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432827.348999:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1787432827.349029:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff94843489b480 x1874258609539200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432827.349038:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609539200:0@lo:400:kworker.0 00000100:00080000:0.0:1787432827.349054:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432827.349209:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609538560 00000100:00100000:3.0:1787432827.349215:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609538560 00000100:00080000:0.0:1787432827.349247:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432827.349263:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787432827.349272:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609538560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432827.349320:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609538560:12345-0@lo:400:kworker.0 Request processed in 49us (3362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432827.349328:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787432827.349366:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609538560:0@lo:400:kworker.0 00000100:00100000:0.0:1787432827.388132:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874258609538688:12345-0@lo:38:kworker.0 Request processed in 41463us (42232us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787432827.388159:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1787432827.388250:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843f83d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432827.388256:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787432827.388260:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874258609538688:0@lo:38:kworker.0 00010000:00010000:1.0:1787432828.043382:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432829.078526:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787432829.264451:0:20929:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787432829.294304:0:20929:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1787432829.294369:0:20929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe4a expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.294386:0:20929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fe4a expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.294393:0:20929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fe4a expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.294399:0:20929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fe4a expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.294422:0:20929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787432829.294427:0:20929:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787432829.294451:0:20929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787432829.294456:0:20929:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787432829.294461:0:20929:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787432829.294480:0:20929:0:(import.c:65:import_set_state_nolock()) ffff94843f83d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787432829.294485:0:20929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787432829.294487:0:20929:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787432829.294490:0:20929:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787432829.295576:0:20929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fda9 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.295591:0:20929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fda9 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.295597:0:20929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fda9 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.295604:0:20929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fda9 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.295624:0:20929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787432829.295630:0:20929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33564009d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.295636:0:20929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33564009d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.295642:0:20929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33564009d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.295649:0:20929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33564009d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.295659:0:20929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787432829.295673:0:20929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640233 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.295680:0:20929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640233 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.295685:0:20929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b335640233 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.295690:0:20929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b335640233 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.295696:0:20929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1787432829.295700:0:20929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.295707:0:20929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fd9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.295713:0:20929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fd9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.295719:0:20929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fd9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.295875:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787432829.295883:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fe4a expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.295911:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432829.295915:0:19769:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fe4a expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.295924:0:19769:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563fe4a expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432829.295930:0:19769:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563fe4a expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432829.295935:0:19769:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787432829.295937:0:19769:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787432829.295939:0:19769:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787432829.295974:0:19769:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fe4a expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.295981:0:19769:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432829.296003:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fe4a expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296010:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fe4a expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296022:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787432829.296025:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fda9 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296030:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e4a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432829.296033:0:19769:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fda9 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296051:0:19769:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563fda9 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432829.296067:0:19769:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563fda9 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432829.296073:0:19769:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787432829.296075:0:19769:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1787432829.296088:0:19769:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fda9 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296093:0:19769:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432829.296108:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fda9 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296115:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fda9 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296123:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432829.296126:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33564009d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296131:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489200 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432829.296133:0:19769:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33564009d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296140:0:19769:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33564009d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432829.296145:0:19769:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33564009d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432829.296156:0:19769:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787432829.296158:0:19769:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787432829.296160:0:19769:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787432829.296195:0:19769:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33564009d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296201:0:19769:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432829.296206:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33564009d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296212:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33564009d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296224:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432829.296228:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b335640233 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296234:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f05e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432829.296237:0:19769:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b335640233 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296242:0:19769:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b335640233 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432829.296247:0:19769:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b335640233 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432829.296253:0:19769:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787432829.296255:0:19769:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787432829.296261:0:19769:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787432829.296273:0:19769:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b335640233 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296279:0:19769:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432829.296285:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b335640233 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296290:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b335640233 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432829.296298:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432829.296300:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432829.296301:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432829.296328:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609539328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432829.296402:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432829.296451:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432829.296457:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609539712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432829.296479:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432829.296504:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609539456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432829.296525:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432829.296540:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432829.296545:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609539584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432829.296564:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432829.296591:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609539328 00000100:00100000:1.0:1787432829.296598:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609539328 00000100:00100000:1.0:1787432829.296627:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609539712 00000100:00100000:1.0:1787432829.296630:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609539712 00000100:00100000:1.0:1787432829.296637:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609539456 00000100:00100000:1.0:1787432829.296639:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609539456 00000100:00100000:1.0:1787432829.296653:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609539584 00000100:00100000:1.0:1787432829.296656:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609539584 00000100:00100000:1.0:1787432829.296667:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432829.296676:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3642:x1874258609539328:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787432829.296682:0:18685:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787432829 with bad export cookie 14587919725282720878 00010000:00010000:3.0:1787432829.297910:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432829.297920:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432829.297959:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787432829.297967:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1874258609539712:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787432829.297974:0:17140:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787432829 with bad export cookie 14587919725282720878 00000100:00100000:3.0:1787432829.298072:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1874258609539712:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (1591us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787432829.298079:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787432829.298104:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787432829.298108:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1874258609539456:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787432829.298112:0:17140:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787432829 with bad export cookie 14587919725282720878 00000100:00100000:3.0:1787432829.298142:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1874258609539456:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (1616us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787432829.298149:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787432829.298161:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787432829.298200:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1874258609539584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787432829.298205:0:17140:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787432829 with bad export cookie 14587919725282720878 00000100:00100000:3.0:1787432829.298232:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1874258609539584:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (1667us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787432829.298251:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787432829.298286:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.124@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787432829.298291:0:3642:0:(import.c:65:import_set_state_nolock()) ffff948409d2d800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787432829.298295:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.124@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1787432829.298375:0:20929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787432829.298384:0:20929:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1787432829.298389:0:20929:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1787432829.298431:0:20929:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1787432829.298435:0:20929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1787432829.298440:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432829.298452:0:20929:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1787432829.298457:0:20929:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff948434880000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787432829.298462:0:20929:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9483027d7000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787432829.298468:0:20929:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff94841de999b8) has exports, disconnecting them 00000020:00080000:2.0:1787432829.298472:0:20929:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff948434880000), last request at 1787432827 00000020:00000080:2.0:1787432829.298479:0:20929:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b335640088 00000100:00080000:2.0:1787432829.298495:0:20929:0:(import.c:65:import_set_state_nolock()) ffff948434886000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787432829.298547:0:20929:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff948434880000): rc 0 00000020:00000080:2.0:1787432829.298550:0:20929:0:(genops.c:885:class_export_put()) final put ffff948434880000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1787432829.298560:0:20929:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9483027d7000), last request at 1787432827 00000020:00000080:2.0:1787432829.298563:0:20929:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ff23 00000100:00080000:2.0:1787432829.298569:0:20929:0:(import.c:65:import_set_state_nolock()) ffff9483027d1800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787432829.298576:0:20929:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9483027d7000): rc 0 00000020:00000080:2.0:1787432829.298579:0:20929:0:(genops.c:885:class_export_put()) final put ffff9483027d7000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1787432829.298585:0:20929:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb0c1c1c93ae0 00000100:00080000:2.0:1787432829.298615:0:20929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787432829.298624:0:20929:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff948303a38e00 x1874258609536128/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787432835 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432829.298639:0:20929:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787432829.299499:0:20929:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787432829.299505:0:20929:0:(import.c:65:import_set_state_nolock()) ffff9483039ef800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:2.0:1787432829.299563:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948434880000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1787432829.299617:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9483027d7000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1787432829.299639:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948434886000 for lustre-MDT0001 00000020:00000080:2.0:1787432829.299644:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9483027d1800 for lustre-MDT0001 00010000:00010000:2.0:1787432829.299655:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432829.299662:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fd9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.299683:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e5600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432829.299686:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fd9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.299695:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563fd9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432829.299702:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563fd9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432829.299709:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787432829.299712:0:17142:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787432829.299714:0:17142:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787432829.306001:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432829.309336:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3642:x1874258609539328:12345-0@lo:103:ldlm_bl.0 Request processed in 12652us (12926us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787432829.309353:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787432829.312807:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.124@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787432829.320617:0:20929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787432829.320627:0:20929:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1787432829.320648:0:20929:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787432829.320713:0:20929:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787432829.320763:0:20929:0:(import.c:65:import_set_state_nolock()) ffff948434887000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787432829.320782:0:20929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787432829.320785:0:20929:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1787432829.320792:0:20929:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787432829.320863:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609539840:0@lo:9:umount.0 00000100:00100000:0.0:1787432829.320929:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787432829.320980:0:20929:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787432829.320991:0:20929:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787432829.321007:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609539968:0@lo:9:umount.0 00000100:00100000:0.0:1787432829.321032:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787432829.321101:0:20929:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff94841de999b8) has no exports 00000100:00080000:3.0:1787432829.326576:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.124@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787432829.326582:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787432829.326592:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff948434899f80 x1874258609538304/t0(0) o400->MGC192.168.204.124@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787432843 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432829.326606:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94843f919f80 x1874258609539328/t0(0) o103->MGC192.168.204.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787432845 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432829.326614:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94843f918a80 x1874258609539712/t0(0) o103->MGC192.168.204.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787432845 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432829.326622:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94843f918700 x1874258609539456/t0(0) o103->MGC192.168.204.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787432845 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432829.326630:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94843f91b800 x1874258609539584/t0(0) o103->MGC192.168.204.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787432845 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787432829.326638:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787432829.326640:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787432829.326642:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:2.0:1787432829.327072:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fd9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.327082:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432829.327099:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fd9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.327107:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563fd9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432829.327127:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432829.327129:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432829.327132:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432829.327225:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609536128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432829.327254:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432829.327261:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:0:1874258609540096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432829.327293:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432829.327298:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432829.327310:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:0:1874258609540224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432829.327344:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609539840 00000100:00100000:2.0:1787432829.327355:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609539840 00000100:00100000:2.0:1787432829.327408:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609539968 00000100:00100000:2.0:1787432829.327411:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609539968 00000100:00100000:2.0:1787432829.327436:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787432829.327446:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874258609539840:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787432829.327472:0:19127:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ff4d 00000100:00080000:2.0:1787432829.327480:0:19127:0:(import.c:65:import_set_state_nolock()) ffff9483039e3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432829.327521:0:19127:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787432829.327707:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3640:x1874258609539840:12345-0@lo:9:umount.0 Request processed in 262us (6777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432829.327715:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787432829.327733:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787432829.327740:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874258609539968:12345-0@lo:9:umount.0 00000100:00080000:1.0:1787432829.328002:0:3643:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff948409d2d800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1787432829.328088:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609539456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432829.328104:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609539584:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432829.328130:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787432829.328138:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432829.328142:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432829.328209:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948434887000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787432829.328219:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787432829.328221:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787432829.328224:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609539840:0@lo:9:umount.0 00000020:00000080:2.0:1787432829.329041:0:19127:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b3356400b9 00000100:00080000:2.0:1787432829.329055:0:19127:0:(import.c:65:import_set_state_nolock()) ffff9483039e5800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432829.329105:0:19127:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1787432829.329250:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3640:x1874258609539968:12345-0@lo:9:umount.0 Request processed in 1510us (8216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432829.329259:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1787432829.329301:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787432829.329310:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787432829.329312:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787432829.329315:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609539968:0@lo:9:umount.0 00000100:00080000:3.0:1787432829.330879:0:3642:0:(import.c:65:import_set_state_nolock()) ffff948409d2d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432829.330892:0:3642:0:(import.c:510:import_select_connection()) MGC192.168.204.124@tcp: connect to NID 0@lo last attempt 532 00000100:00080000:3.0:1787432829.330900:0:3642:0:(import.c:624:import_select_connection()) MGC192.168.204.124@tcp: import ffff948409d2d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432829.330934:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94840356b100 x1874258609540352/t0(0) o250->MGC192.168.204.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432829.330978:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609539328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787432829.330989:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609538304:0@lo:400:kworker.0 00000100:00100000:3.0:1787432829.331026:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609539712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787432829.331054:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3640:1874258609540352:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1787432829.331104:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874258609540352 offset 0 length 520: 4 00010000:00010000:1.0:1787432829.331250:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787432829.337633:0:20929:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff94841de999b8) has no exports 00000020:01000000:0.0:1787432829.450695:0:20929:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948301e21b40 - data ffff94842e1c7ca8/ffff94842d492c00 00000020:01000000:0.0:1787432829.451048:0:20929:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948402e33c00 - data ffff94842e041870/ffff94843b31a800 00000001:00000004:2.0:1787432829.466441:0:20929:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1787432829.537518:0:20929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787432829.537526:0:20929:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787432829.537533:0:20929:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787432829.542706:0:20929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787432829.542716:0:20929:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1787432829.542735:0:20929:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787432829.542738:0:20929:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787432829.543449:0:17895:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787432829.543455:0:17895:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1787432829.543464:0:17895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1787432829.544063:0:20929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787432829.544068:0:20929:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1787432829.544089:0:20929:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787432829.544092:0:20929:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787432829.544438:0:17897:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787432829.544441:0:17897:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1787432829.544450:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1787432829.549386:0:20929:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fdb7 00000020:00000080:3.0:1787432829.549400:0:20929:0:(genops.c:885:class_export_put()) final put ffff9484348a6800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787432829.550062:0:20929:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fdcc 00000020:00000080:3.0:1787432829.550068:0:20929:0:(genops.c:885:class_export_put()) final put ffff948434881800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787432829.550074:0:20929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1787432829.550080:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787432829.550089:0:20929:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787432829.550093:0:20929:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff94841de98000) has no exports 00000004:01000000:3.0:1787432829.550275:0:20929:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787432829.550284:0:20929:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fe20 00000020:00000080:3.0:1787432829.550288:0:20929:0:(genops.c:885:class_export_put()) final put ffff94843f86c800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787432829.550292:0:20929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787432829.550296:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787432829.550301:0:20929:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787432829.550303:0:20929:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9484349d0000) has no exports 00000020:00000080:3.0:1787432829.550320:0:20929:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fe19 00000020:00000080:3.0:1787432829.550323:0:20929:0:(genops.c:885:class_export_put()) final put ffff94843c7f3000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1787432829.550648:0:20929:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787432829.550652:0:20929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787432829.550658:0:20929:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1787432829.550664:0:20929:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787432829.550667:0:20929:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787432829.550696:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432829.550703:0:20929:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787432829.550710:0:20929:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fe0b 00000020:00000080:3.0:1787432829.550714:0:20929:0:(genops.c:885:class_export_put()) final put ffff948434880800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787432829.550718:0:20929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787432829.550722:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787432829.550725:0:20929:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787432829.550727:0:20929:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff94843365cd28) has no exports 00000020:00000080:3.0:1787432829.550731:0:20929:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fe04 00000020:00000080:3.0:1787432829.550734:0:20929:0:(genops.c:885:class_export_put()) final put ffff948434884000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1787432829.551024:0:20929:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787432829.551027:0:20929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787432829.551029:0:20929:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1787432829.551033:0:20929:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787432829.551034:0:20929:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787432829.551069:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432829.551074:0:20929:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1787432829.551083:0:20929:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787432829.551088:0:20929:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fdef 00000020:00000080:3.0:1787432829.551093:0:20929:0:(genops.c:885:class_export_put()) final put ffff948301dc1000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787432829.551096:0:20929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1787432829.551100:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787432829.551103:0:20929:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787432829.551105:0:20929:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9484349d19b8) has no exports 00000020:00000080:3.0:1787432829.551108:0:20929:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fde8 00000020:00000080:3.0:1787432829.551116:0:20929:0:(genops.c:885:class_export_put()) final put ffff9483039ec800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787432829.551503:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9484348a6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787432829.551519:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948434881800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1787432829.551524:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843f86c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787432829.551528:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843c7f3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787432829.551533:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843c7f3800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787432829.551545:0:36:0:(genops.c:885:class_export_put()) final put ffff948434887800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787432829.551547:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948434887800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1787432829.551552:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787432829.551627:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948434880800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787432829.551632:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948434884000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787432829.551635:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948434887000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787432829.551638:0:36:0:(genops.c:885:class_export_put()) final put ffff948434885000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787432829.551640:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948434885000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1787432829.551643:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787432829.551667:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dc1000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787432829.551671:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9483039ec800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787432829.555269:0:20929:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787432829.555278:0:20929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787432829.555282:0:20929:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787432829.555290:0:20929:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787432829.555346:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787432829.555358:0:20929:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787432829.555401:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787432829.555404:0:20929:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787432829.555409:0:20929:0:(genops.c:885:class_export_put()) final put ffff94840900e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787432829.555413:0:20929:0:(genops.c:844:class_export_destroy()) destroying export ffff94840900e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787432829.555420:0:20929:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787432829.555569:0:20929:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fdd3 00000020:00000080:0.0:1787432829.555577:0:20929:0:(genops.c:885:class_export_put()) final put ffff948434881000/lustre-MDD0001_UUID 00000020:01000000:0.0:1787432829.555581:0:20929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787432829.555585:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432829.555589:0:20929:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787432829.555594:0:20929:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9484336599b8) has no exports 00000020:00000080:0.0:1787432829.555613:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787432829.555616:0:20929:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787432829.555619:0:20929:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fdda 00000020:00000080:0.0:1787432829.555622:0:20929:0:(genops.c:885:class_export_put()) final put ffff948434883800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787432829.555628:0:20929:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94843f837000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787432829.555631:0:20929:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94843f837000 2 00000020:01000004:0.0:1787432829.555635:0:20929:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94843f837000 from lustre-MDT0001 00000020:00000080:0.0:1787432829.555650:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787432829.555652:0:20929:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787432829.555655:0:20929:0:(genops.c:885:class_export_put()) final put ffff9484348a7800/lustre-MDT0001_UUID 00000020:00000080:0.0:1787432829.555657:0:20929:0:(genops.c:844:class_export_destroy()) destroying export ffff9484348a7800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787432829.555663:0:20929:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1787432829.555686:0:20929:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1787432829.555690:0:20929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787432829.555692:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432829.555706:0:20929:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787432829.555712:0:20929:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9484337c6000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787432829.555717:0:20929:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff94843b9599b8) has exports, disconnecting them 00000020:00080000:0.0:1787432829.555722:0:20929:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9484337c6000), last request at 1787432737 00000020:00000080:0.0:1787432829.555725:0:20929:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fe58 00000020:00080000:0.0:1787432829.555739:0:20929:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9484337c6000): rc 0 00000020:00000080:0.0:1787432829.555742:0:20929:0:(genops.c:885:class_export_put()) final put ffff9484337c6000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787432829.555832:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9483039ef800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787432829.555840:0:36:0:(genops.c:885:class_export_put()) final put ffff948301dc0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787432829.555842:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dc0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1787432829.555846:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787432829.555928:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948434881000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1787432829.555931:0:36:0:(genops.c:885:class_export_put()) final put ffff9484348a5800/lustre-MDD0001_UUID 00000020:00000080:1.0:1787432829.555933:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9484348a5800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1787432829.555936:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1787432829.556079:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948434883800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787432829.556083:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9484337c6000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1787432829.587254:0:20929:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1787432829.587263:0:20929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787432829.587268:0:20929:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787432829.587277:0:20929:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787432829.587322:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843f83d800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1787432829.591266:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787432829.591281:0:20929:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1787432829.591287:0:20929:0:(genops.c:885:class_export_put()) final put ffff94843c7f2000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1787432829.591292:0:20929:0:(genops.c:844:class_export_destroy()) destroying export ffff94843c7f2000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1787432829.591298:0:20929:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1787432829.591574:0:20929:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94843f837000 1 00000020:00000080:0.0:1787432829.591582:0:20929:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fd7f 00000020:00000080:0.0:1787432829.591589:0:20929:0:(genops.c:885:class_export_put()) final put ffff948427f81800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1787432829.591610:0:20929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1787432829.591614:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432829.591619:0:20929:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787432829.591623:0:20929:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff94843361cd28) has no exports 00000020:00000080:1.0:1787432829.591719:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948427f81800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787432829.655994:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432829.656008:0:20929:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1787432829.656014:0:20929:0:(genops.c:885:class_export_put()) final put ffff94843f837800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787432829.656018:0:20929:0:(genops.c:844:class_export_destroy()) destroying export ffff94843f837800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1787432829.656039:0:20929:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1787432829.656200:0:20929:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94843f832800 00000020:01000000:1.0:1787432829.656219:0:20929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787432829.656224:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432829.656229:0:20929:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787432829.656233:0:20929:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9483030f3370) has no exports 00000100:00100000:3.0:1787432829.657563:0:17155:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff94840388f000:17155] 1 exiting: rc = 0 00000100:00100000:3.0:1787432829.657676:0:20092:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9484359cb800:20092] 3 exiting: rc = 0 00000100:00100000:3.0:1787432829.657737:0:20843:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff94843489d400:20843] 4 exiting: rc = 0 00000100:00100000:0.0:1787432829.657903:0:17154:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff948303862a00:17154] 0 exiting: rc = 1 00000100:00100000:0.0:1787432829.658028:0:17156:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff948406c95600:17156] 2 exiting: rc = 0 00000100:00100000:1.0:1787432829.658223:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658231:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658236:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658241:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658246:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658250:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658256:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658262:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658268:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658274:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658279:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658284:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658290:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658296:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658301:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658306:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658312:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658318:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658323:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658329:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658335:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658342:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658347:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658352:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658358:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658363:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658368:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658373:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658378:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658398:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658404:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658410:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658416:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658422:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658427:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658432:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658438:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658456:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658463:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658469:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658475:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658480:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658486:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658492:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658498:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658503:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658510:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658515:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658522:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658527:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658532:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658537:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658543:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658548:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658553:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658559:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658563:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658569:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658574:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658580:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658585:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658590:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658594:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.658608:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.671915:0:17158:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff948434bd1800:17158] 1 exiting: rc = 0 00000100:00100000:3.0:1787432829.672138:0:17157:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9484012e6800:17157] 0 exiting: rc = 1 00000100:00100000:1.0:1787432829.672327:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672336:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672342:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672348:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672353:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672358:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672363:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672368:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672372:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672377:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672382:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672387:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672392:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672396:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672401:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672406:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672411:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672416:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672421:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672427:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672432:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672436:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672441:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672446:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672451:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672456:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672460:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672465:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672471:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672476:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672481:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672486:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672492:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672497:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672501:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672519:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672524:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672529:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672534:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672543:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672549:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672554:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672559:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672564:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672570:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672575:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672580:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672585:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672591:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672596:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672601:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672606:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672610:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672615:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672620:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672625:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672630:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672634:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672640:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672645:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672651:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672656:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672661:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.672666:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432829.675859:0:17159:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff94843352d400:17159] 0 exiting: rc = 1 00000100:00100000:0.0:1787432829.676025:0:17160:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff94843352ce00:17160] 1 exiting: rc = 0 00000100:00100000:1.0:1787432829.676545:0:17894:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9484033ea000:17894] 2 exiting: rc = 0 00000100:00100000:0.0:1787432829.676649:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676657:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676685:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676692:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676697:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676703:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676710:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676716:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676722:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676728:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676733:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676740:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676745:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676751:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676772:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676779:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676784:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676793:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676799:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676804:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676811:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676816:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676823:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676828:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676837:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676843:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676862:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676870:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676876:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676883:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676889:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676895:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676902:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676909:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676915:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676920:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676927:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676941:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676975:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676984:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676990:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.676997:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677003:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677010:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677017:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677023:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677030:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677036:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677042:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677048:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677076:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677083:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677089:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677096:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677101:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677107:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677113:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677118:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677124:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677129:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677135:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677141:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677146:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.677152:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432829.694559:0:17161:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff94843352d000:17161] 0 exiting: rc = 1 00000100:00100000:1.0:1787432829.694722:0:17162:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9483037adc00:17162] 1 exiting: rc = 0 00000100:00100000:0.0:1787432829.695324:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695332:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695337:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695342:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695347:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695352:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695358:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695363:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695380:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695386:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695391:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695395:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695400:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695405:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695409:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695414:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695419:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695423:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695428:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695433:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695437:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695442:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695447:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695451:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695455:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695460:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695465:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695469:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695474:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695478:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695483:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695488:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695493:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695497:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695502:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695507:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695512:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695518:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695523:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695528:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695534:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695539:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695544:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695558:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695563:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695569:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695574:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695579:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695584:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695590:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695595:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695600:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695606:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695612:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695617:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695622:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695628:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695634:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695639:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695644:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695649:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695653:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695658:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.695662:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.699739:0:17164:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9483037ac200:17164] 1 exiting: rc = 0 00000100:00100000:3.0:1787432829.700845:0:17163:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9483037acc00:17163] 0 exiting: rc = 1 00000100:00100000:1.0:1787432829.701065:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701073:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701079:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701084:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701106:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701112:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701117:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701122:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701128:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701134:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701140:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701145:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701151:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701156:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701161:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701197:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701203:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701209:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701213:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701218:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701223:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701227:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701233:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701249:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701254:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701260:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701265:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701270:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701275:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701280:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701286:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701291:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701296:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701301:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701306:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701311:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701316:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701321:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701325:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701337:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701342:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701347:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701351:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701356:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701361:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701366:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701371:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701376:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701382:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701387:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701392:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701397:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701402:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701407:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701413:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701419:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701424:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701430:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701435:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701440:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701445:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701451:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701456:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.701462:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432829.701842:0:17165:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff948434bd0400:17165] 0 exiting: rc = 1 00000100:00100000:3.0:1787432829.701957:0:17166:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff948434bd0200:17166] 1 exiting: rc = 0 00000100:00100000:1.0:1787432829.703151:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703160:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703222:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703228:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703234:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703239:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703244:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703250:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703255:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703260:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703280:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703285:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703290:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703295:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703300:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703306:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703311:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703316:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703321:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703326:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703331:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703336:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703341:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703346:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703350:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703356:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703361:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703366:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703370:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703376:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703380:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703385:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703391:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703397:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703403:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703408:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703412:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703418:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703422:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703427:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703432:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703437:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703441:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703446:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703450:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703462:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703468:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703473:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703479:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703484:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703489:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703493:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703498:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703503:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703508:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703515:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703520:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703525:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703530:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703535:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703541:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703546:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703551:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.703556:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432829.704188:0:17168:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff948411696200:17168] 1 exiting: rc = 0 00000100:00100000:0.0:1787432829.704478:0:17167:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff948411697400:17167] 0 exiting: rc = 1 00000100:00100000:2.0:1787432829.704691:0:17169:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff948434bd1600:17169] 2 exiting: rc = 0 00000100:00100000:1.0:1787432829.705334:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705342:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705348:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705354:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705378:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705384:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705389:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705394:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705399:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705404:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705409:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705415:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705422:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705427:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705433:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705439:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705461:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705466:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705471:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705477:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705482:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705488:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705493:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705499:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705505:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705509:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705516:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705520:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705541:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705548:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705553:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705559:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705564:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705570:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705576:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705583:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705588:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705594:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705600:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705606:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705612:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705618:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705623:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705630:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705636:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705642:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705647:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705653:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705658:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705663:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705669:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705682:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705700:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705707:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705713:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705719:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705725:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705731:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705737:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705742:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705748:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705753:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705758:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432829.705764:0:20929:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787432829.723428:0:20929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432829.723443:0:20929:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787432829.723449:0:20929:0:(genops.c:885:class_export_put()) final put ffff948409d29800/MDS_uuid 00000020:00000080:1.0:1787432829.723453:0:20929:0:(genops.c:844:class_export_destroy()) destroying export ffff948409d29800/MDS_uuid for MDS 00000020:01000000:1.0:1787432829.723462:0:20929:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787432829.723617:0:20929:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1787432830.095944:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432831.126419:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432832.140538:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432832.459702:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432832.459718:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432832.459721:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432832.459724:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787432832.459728:0:8:0:(import.c:65:import_set_state_nolock()) ffff948301d56000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432832.459736:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 638 00000100:00080000:0.0:1787432832.459741:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787432832.459754:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff948301d56000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432832.459790:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948434899c00 x1874258609540480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432832.459833:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432832.459836:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787432832.459838:0:8:0:(import.c:65:import_set_state_nolock()) ffff94830347d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432832.459841:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 638 00000100:00080000:0.0:1787432832.459843:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787432832.459846:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94830347d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432832.459858:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948434899880 x1874258609540736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432832.459950:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609540480:0@lo:38:kworker.0 00000400:00000100:0.0:1787432832.460013:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609540480 offset 0 length 520: 4 00000100:00100000:0.0:1787432832.460044:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609540736:0@lo:38:kworker.0 00000400:00000100:0.0:1787432832.460062:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609540736 offset 0 length 520: 4 00000100:00100000:0.0:1787432832.460089:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609540608:0@lo:400:kworker.0 00000400:00000100:0.0:1787432832.460108:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609540608 offset 0 length 224: 4 00000100:00100000:0.0:1787432832.460130:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609540864:0@lo:400:kworker.0 00000400:00000100:0.0:1787432832.460148:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609540864 offset 0 length 224: 4 00010000:00010000:3.0:1787432833.163518:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432834.188226:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787432834.307819:0:21131:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787432834.320344:0:21131:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787432834.320407:0:21131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fef9 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432834.320422:0:21131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fef9 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432834.320430:0:21131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fef9 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432834.320438:0:21131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fef9 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432834.320480:0:21131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787432834.320487:0:21131:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787432834.320515:0:21131:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1787432834.320525:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787432834.320531:0:21131:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff948434899c00 x1874258609540480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787432852 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787432834.320536:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fef9 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432834.320548:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e4e00 already unused, calling callback (ffffffffc122fc20) 00000100:00100000:1.0:1787432834.320551:0:21131:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 10000000:00010000:2.0:1787432834.320553:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fef9 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787432834.320561:0:21131:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1787432834.320567:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563fef9 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787432834.320570:0:21131:0:(import.c:65:import_set_state_nolock()) ffff948301d56000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787432834.320579:0:21131:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:2.0:1787432834.320582:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563fef9 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432834.320586:0:21131:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff948434899c00 x1874258609540480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787432852 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787432834.320595:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787432834.320604:0:17142:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:1.0:1787432834.320605:0:21131:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 10000000:01000000:2.0:1787432834.320609:0:17142:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1787432834.320610:0:21131:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:2.0:1787432834.320630:0:17142:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948409d2d800 00010000:00010000:2.0:1787432834.320635:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563fef9 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432834.320641:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563fef9 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432834.320653:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432834.320665:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432834.320668:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432834.320708:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609540480:0@lo:38:kworker.0 00000100:00080000:1.0:1787432834.321649:0:21131:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787432834.321659:0:21131:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94843489b800 x1874258609540608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432848 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432834.321684:0:21131:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787432834.321688:0:21131:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787432834.321711:0:21131:0:(import.c:65:import_set_state_nolock()) ffff948301d55800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787432834.321873:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609540608:0@lo:400:kworker.0 00000100:00100000:3.0:1787432834.321905:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874258609540992:0@lo:39:umount.0 00000400:00000100:3.0:1787432834.321952:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609540992 offset 0 length 224: 4 00000100:00080000:2.0:1787432834.507327:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787432834.507354:0:474:0:(pinger.c:247:ptlrpc_pinger_process_import()) a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432834.507358:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787432834.507361:0:474:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787432834.507449:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609541120:0@lo:400:kworker.0 00000400:00000100:0.0:1787432834.507519:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609541120 offset 0 length 224: 4 00000001:00100000:3.0:1787432835.025329:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787432835.025339:0:18655:0:(genops.c:885:class_export_put()) final put ffff9483039e6000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787432835.025931:0:19475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787432835.025936:0:19475:0:(genops.c:885:class_export_put()) final put ffff9483039e4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787432835.026113:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9483039e6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787432835.026194:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9483039e3800 for lustre-OST0000 00000020:00000080:2.0:1787432835.026359:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff9483039e4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787432835.026620:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9483039e5800 for lustre-OST0001 00010000:00010000:3.0:1787432835.211434:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432836.235446:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432837.259587:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787432837.515487:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787432837.515500:0:474:0:(pinger.c:247:ptlrpc_pinger_process_import()) a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432837.515503:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787432837.515506:0:474:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787432837.515620:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609541248:0@lo:400:kworker.0 00000400:00000100:1.0:1787432837.515690:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609541248 offset 0 length 224: 4 00010000:00010000:3.0:1787432838.287589:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432839.308617:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432839.440618:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432829/real 1787432829] req@ffff94840356b100 x1874258609540352/t0(0) o250->MGC192.168.204.124@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787432839 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432839.440655:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94840356b100 x1874258609540352/t0(0) o250->MGC192.168.204.124@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787432839 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787432839.440678:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948409d2d800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787432839.440721:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787432839.440726:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3640:1874258609540352:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1787432839.440776:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787432839.440787:0:474:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787432839.440789:0:474:0:(import.c:65:import_set_state_nolock()) ffff948409d2d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787432839.440795:0:474:0:(import.c:510:import_select_connection()) MGC192.168.204.124@tcp: connect to NID 0@lo last attempt 640 00000100:00080000:1.0:1787432839.440800:0:474:0:(import.c:589:import_select_connection()) MGC192.168.204.124@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787432839.440805:0:474:0:(import.c:624:import_select_connection()) MGC192.168.204.124@tcp: import ffff948409d2d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432839.440851:0:474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9483039b7480 x1874258609541376/t0(0) o250->MGC192.168.204.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787432839.440884:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787432839.440889:0:474:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787432839.440967:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3640:1874258609541376:0@lo:250:kworker.0 00000400:00000100:3.0:1787432839.441015:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874258609541376 offset 0 length 520: 4 00000100:00100000:0.0:1787432839.441061:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609541504:0@lo:400:kworker.0 00000400:00000100:0.0:1787432839.441089:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609541504 offset 0 length 224: 4 00010000:00010000:2.0:1787432840.331693:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432841.356455:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432842.379813:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432843.403582:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432844.427943:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432844.555524:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432834/real 1787432834] req@ffff9483039b7b80 x1874258609540992/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787432844 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432844.555559:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9483039b7b80 x1874258609540992/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787432844 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787432844.555583:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948301d55800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787432844.555603:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874258609540992:0@lo:39:umount.0 00000100:00080000:1.0:1787432844.555985:0:21131:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787432844.555990:0:21131:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787432844.555995:0:21131:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787432844.559463:0:21131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fecf expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432844.559484:0:21131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fecf expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432844.559491:0:21131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fecf expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432844.559498:0:21131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563fecf expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432844.559538:0:21131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432844.559546:0:21131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640225 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432844.559572:0:21131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640225 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432844.559578:0:21131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b335640225 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432844.559585:0:21131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b335640225 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432844.559606:0:21131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787432844.559611:0:21131:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787432844.559649:0:21131:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787432844.559653:0:21131:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787432844.559658:0:21131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432844.559663:0:21131:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787432844.559668:0:21131:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff94843b95cd28) has no exports 00000020:00080000:1.0:1787432844.559701:0:21131:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff94843b95cd28) has no exports 00010000:00010000:2.0:1787432844.559735:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432844.559744:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fecf expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432844.559752:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e5c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432844.559756:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563fecf expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432844.559774:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563fecf expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432844.559781:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563fecf expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432844.559786:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787432844.559796:0:17142:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787432844.559798:0:17142:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787432844.559813:0:17142:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948409d2d800 00010000:00010000:2.0:1787432844.559818:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563fecf expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432844.559824:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563fecf expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432844.559838:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432844.559842:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b335640225 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432844.559847:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f04400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432844.559850:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b335640225 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432844.559858:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b335640225 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432844.559863:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b335640225 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432844.559868:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787432844.559870:0:17142:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787432844.559871:0:17142:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787432844.559877:0:17142:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948409d2d800 00010000:00010000:2.0:1787432844.559880:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b335640225 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432844.559886:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b335640225 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432844.559900:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432844.559902:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432844.559904:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432844.562156:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787432844.564220:0:21131:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948301e21d80 - data ffff9484073d3438/ffff94842d492400 00000020:01000000:1.0:1787432844.564404:0:21131:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948402ac86c0 - data ffff94842e2e0438/ffff94843688d000 00100000:10000000:1.0:1787432844.583831:0:21131:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787432844.595912:0:21131:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fedd 00000020:00000080:3.0:1787432844.595926:0:21131:0:(genops.c:885:class_export_put()) final put ffff9483039e7000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787432844.595958:0:21131:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948301dc6000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787432844.595962:0:21131:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948301dc6000 2 00000020:01000004:3.0:1787432844.595966:0:21131:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff948301dc6000 from lustre-OST0000 00000020:00000080:2.0:1787432844.595983:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9483039e7000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787432844.595995:0:21131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432844.596008:0:21131:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787432844.596011:0:21131:0:(genops.c:885:class_export_put()) final put ffff9483039e6800/lustre-OST0000_UUID 00000020:00000080:3.0:1787432844.596016:0:21131:0:(genops.c:844:class_export_destroy()) destroying export ffff9483039e6800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787432844.596022:0:21131:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787432844.596367:0:21131:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787432844.596373:0:21131:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787432844.596377:0:21131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432844.596383:0:21131:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787432844.596391:0:21131:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff948301d56800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787432844.596396:0:21131:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff948433658000) has exports, disconnecting them 00000020:00080000:2.0:1787432844.596401:0:21131:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff948301d56800), last request at 1787432753 00000020:00000080:2.0:1787432844.596406:0:21131:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ff07 00000020:00080000:2.0:1787432844.596418:0:21131:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff948301d56800): rc 0 00000020:00000080:2.0:1787432844.596423:0:21131:0:(genops.c:885:class_export_put()) final put ffff948301d56800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787432844.597345:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948301d56800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787432844.597368:0:21131:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787432844.597380:0:21131:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787432844.597384:0:21131:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787432844.597389:0:21131:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787432844.597406:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948301d56000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787432844.597552:0:21131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432844.597558:0:21131:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787432844.597562:0:21131:0:(genops.c:885:class_export_put()) final put ffff948427f86800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787432844.597564:0:21131:0:(genops.c:844:class_export_destroy()) destroying export ffff948427f86800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787432844.597569:0:21131:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1787432844.597617:0:21131:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787432844.597621:0:21131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787432844.597624:0:21131:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787432844.597630:0:21131:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9483027d5800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787432844.597635:0:21131:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff94843365b370) has exports, disconnecting them 00000020:00080000:3.0:1787432844.597639:0:21131:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9483027d5800), last request at 1787432753 00000020:00000080:3.0:1787432844.597642:0:21131:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ff1c 00000020:00080000:3.0:1787432844.597652:0:21131:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9483027d5800): rc 0 00000020:00000080:3.0:1787432844.597655:0:21131:0:(genops.c:885:class_export_put()) final put ffff9483027d5800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787432844.597681:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9483027d5800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787432844.608330:0:21131:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787432844.608341:0:21131:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787432844.608345:0:21131:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787432844.608363:0:21131:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787432844.611228:0:21131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787432844.611837:0:21131:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787432844.611851:0:21131:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948301dc6000 1 00000020:00000080:0.0:1787432844.611857:0:21131:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563feba 00000020:00000080:0.0:1787432844.611866:0:21131:0:(genops.c:885:class_export_put()) final put ffff9483039ea800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787432844.611937:0:21131:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787432844.611945:0:21131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432844.611953:0:21131:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787432844.611957:0:21131:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9483030f4d28) has no exports 00000020:00000080:3.0:1787432844.620456:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948301d55800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787432844.620471:0:8:0:(genops.c:885:class_export_put()) final put ffff948301d55000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787432844.620475:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948301d55000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787432844.620483:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787432844.620548:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9483039ea800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787432844.669288:0:21131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787432844.669303:0:21131:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787432844.669309:0:21131:0:(genops.c:885:class_export_put()) final put ffff9483039ea000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787432844.669314:0:21131:0:(genops.c:844:class_export_destroy()) destroying export ffff9483039ea000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787432844.669324:0:21131:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787432844.669461:0:21131:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9484106b5000 00000020:02000400:0.0:1787432844.669518:0:21131:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1787432844.749918:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787432844.749930:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432844.749933:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787432844.749942:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787432844.750110:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432844.750134:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609541632:0@lo:400:kworker.0 00000400:00000100:0.0:1787432844.750427:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609541632 offset 0 length 224: 4 00010000:00010000:3.0:1787432845.451405:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432846.478139:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432847.504292:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432848.523870:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1787432848.846704:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432832/real 1787432832] req@ffff948434898380 x1874258609540864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787432848 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432848.925478:0:3641:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff948434898380 x1874258609540864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787432848 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787432848.925494:0:3641:0:(import.c:65:import_set_state_nolock()) ffff94843c7f6800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787432848.925498:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787432848.960134:0:3641:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1787432848.961382:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609540864:0@lo:400:kworker.0 00000100:00080000:1.0:1787432848.962241:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787432848.962247:0:474:0:(pinger.c:247:ptlrpc_pinger_process_import()) a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787432848.962250:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787432848.962264:0:474:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787432848.962266:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787432848.962270:0:474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787432848.962280:0:474:0:(import.c:65:import_set_state_nolock()) ffff94843c7f6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787432848.962286:0:474:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 581 00000100:00080000:1.0:1787432848.962295:0:474:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff94843c7f6800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432848.962330:0:474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9483039b6a00 x1874258609541760/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432848.962858:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874258609541760:0@lo:38:kworker.0 00000400:00000100:0.0:1787432848.962921:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609541760 offset 0 length 520: 4 00000020:01000004:1.0:1787432849.000897:0:21333:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787432849.038722:0:21333:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787432849.038817:0:21333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33564005e expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432849.038832:0:21333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33564005e expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432849.038839:0:21333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33564005e expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432849.038846:0:21333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33564005e expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432849.038870:0:21333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787432849.038876:0:21333:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787432849.038901:0:21333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787432849.038914:0:21333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff948434899880 x1874258609540736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787432852 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432849.038935:0:21333:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787432849.038944:0:21333:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787432849.038951:0:21333:0:(import.c:65:import_set_state_nolock()) ffff94830347d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787432849.038957:0:21333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787432849.038960:0:21333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff948434899880 x1874258609540736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787432852 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432849.038984:0:21333:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787432849.038988:0:21333:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:0.0:1787432849.039123:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609540736:0@lo:38:kworker.0 00010000:00010000:3.0:1787432849.039294:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432849.039302:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33564005e expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432849.039310:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e5a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1787432849.039313:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33564005e expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432849.039322:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33564005e expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432849.039330:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33564005e expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432849.039336:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787432849.039339:0:17142:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787432849.039341:0:17142:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787432849.039355:0:17142:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948409d2d800 00010000:00010000:3.0:1787432849.039359:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33564005e expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432849.039376:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33564005e expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432849.039388:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432849.039390:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432849.039392:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432849.042812:0:21333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787432849.042829:0:21333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94843f923b80 x1874258609541120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432850 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432849.042856:0:21333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94843f922300 x1874258609541248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432853 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432849.042873:0:21333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9483039b6300 x1874258609541504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432855 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432849.042889:0:21333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94840356b100 x1874258609541632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432860 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432849.042898:0:21333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9483039b6a00 x1874258609541760/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787432858 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432849.042923:0:21333:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787432849.042957:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f6800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432849.042963:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1787432849.042967:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874258609541760:0@lo:38:kworker.0 00000100:00080000:0.0:1787432849.042999:0:21333:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787432849.043004:0:21333:0:(import.c:65:import_set_state_nolock()) ffff94843c7f6800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787432849.043009:0:21333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787432849.043013:0:21333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94843f923b80 x1874258609541120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432850 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432849.043021:0:21333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94843f922300 x1874258609541248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432853 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432849.043028:0:21333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9483039b6300 x1874258609541504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432855 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432849.043035:0:21333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94840356b100 x1874258609541632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432860 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432849.043068:0:21333:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787432849.043072:0:21333:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:3.0:1787432849.043123:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609541504:0@lo:400:kworker.0 00000100:00100000:2.0:1787432849.043283:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609541632:0@lo:400:kworker.0 00000100:00100000:2.0:1787432849.043290:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609541120:0@lo:400:kworker.0 00000100:00100000:1.0:1787432849.043863:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609541248:0@lo:400:kworker.0 00010000:00010000:0.0:1787432849.046128:0:21333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640034 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432849.046148:0:21333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640034 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432849.046156:0:21333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b335640034 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432849.046444:0:21333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b335640034 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432849.046528:0:21333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432849.046538:0:21333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640217 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432849.046557:0:21333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640217 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432849.046563:0:21333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b335640217 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432849.046568:0:21333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b335640217 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432849.049567:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432849.049581:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b335640034 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432849.049594:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e4600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432849.049599:0:19769:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b335640034 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432849.049609:0:19769:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b335640034 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432849.049617:0:19769:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b335640034 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432849.049623:0:19769:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787432849.049634:0:19769:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1787432849.049648:0:19769:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948409d2d800 00010000:00010000:2.0:1787432849.049652:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b335640034 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432849.049659:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b335640034 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432849.049686:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432849.049691:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b335640217 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432849.049696:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432849.049699:0:19769:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b335640217 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432849.049728:0:19769:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b335640217 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432849.049735:0:19769:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b335640217 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432849.049750:0:19769:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787432849.049753:0:19769:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787432849.049758:0:19769:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948409d2d800 00010000:00010000:2.0:1787432849.049761:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b335640217 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432849.049768:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432849.049770:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432849.049772:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432849.050388:0:21333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787432849.050398:0:21333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b335640217 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432849.050422:0:21333:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787432849.050428:0:21333:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1787432849.050430:0:21333:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787432849.050465:0:21333:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787432849.050470:0:21333:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787432849.050477:0:21333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432849.050482:0:21333:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787432849.050486:0:21333:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9484093b4d28) has no exports 00000020:00080000:0.0:1787432849.050512:0:21333:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9484093b4d28) has no exports 00000020:01000000:0.0:1787432849.065344:0:21333:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948301e21d20 - data ffff94842e2df870/ffff94842d492000 00000020:01000000:0.0:1787432849.065535:0:21333:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94843c6a4cc0 - data ffff94842e25dca8/ffff94843bc08800 00010000:00010000:2.0:1787432849.071411:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787432849.082929:0:21333:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787432849.115815:0:21333:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b335640042 00000020:00000080:1.0:1787432849.116480:0:21333:0:(genops.c:885:class_export_put()) final put ffff948304713800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787432849.116511:0:21333:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948301d52800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787432849.116516:0:21333:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948301d52800 2 00000020:01000004:1.0:1787432849.116519:0:21333:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff948301d52800 from lustre-OST0001 00000020:00000080:2.0:1787432849.117336:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff948304713800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787432849.117446:0:21333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432849.117456:0:21333:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787432849.117460:0:21333:0:(genops.c:885:class_export_put()) final put ffff948301e00000/lustre-OST0001_UUID 00000020:00000080:1.0:1787432849.117462:0:21333:0:(genops.c:844:class_export_destroy()) destroying export ffff948301e00000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787432849.117469:0:21333:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787432849.117802:0:21333:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b->MGS 00010000:00010000:1.0:1787432849.118064:0:21333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e4000/0xca72b3b33563fd86 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563fd8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432849.118082:0:21333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4000/0xca72b3b33563fd86 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563fd8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432849.118090:0:21333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787432849.118093:0:21333:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787432849.118096:0:21333:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787432849.118115:0:21333:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948409d2d800 00010000:00010000:1.0:1787432849.118249:0:21333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e4000/0xca72b3b33563fd86 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563fd8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432849.118267:0:21333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432849.118454:0:21333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432849.118459:0:21333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787432849.118462:0:21333:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787432849.118463:0:21333:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787432849.118473:0:21333:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948409d2d800 00010000:00010000:1.0:1787432849.118476:0:21333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787432849.118491:0:21333:0:(import.c:65:import_set_state_nolock()) ffff948409d2d800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787432849.118495:0:21333:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787432849.118498:0:21333:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787432849.118502:0:21333:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787432849.118507:0:21333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787432849.118518:0:21333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9483039b7480 x1874258609541376/t0(0) o250->MGC192.168.204.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787432854 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787432849.118535:0:21333:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787432849.118538:0:21333:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1787432849.130262:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3640:1874258609541376:0@lo:250:kworker.0 10000000:01000000:2.0:1787432849.130370:0:21333:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787432849.130384:0:21333:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563fc60 00000020:00000080:2.0:1787432849.130393:0:21333:0:(genops.c:885:class_export_put()) final put ffff948409d29000/a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b 00000020:01000000:2.0:1787432849.130415:0:21333:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.124@tcp (flags='') 00000020:00000080:2.0:1787432849.130425:0:21333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432849.130432:0:21333:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.124@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787432849.130435:0:21333:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9483030f0000) has no exports 00000020:00000080:1.0:1787432849.130704:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff948409d29000/a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b for MGC192.168.204.124@tcp 10000000:01000000:3.0:1787432849.130789:0:17151:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787432849.130902:0:21333:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.124@tcp: client import never connected 00000100:00080000:1.0:1787432849.130906:0:21333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787432849.130909:0:21333:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787432849.130911:0:21333:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787432849.130913:0:21333:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787432849.130958:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948409d2d800 for MGC192.168.204.124@tcp 00000020:00000080:1.0:1787432849.130971:0:21333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432849.130979:0:21333:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.124@tcp (uuid a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b) 00000020:01000000:1.0:1787432849.130985:0:21333:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787432849.131002:0:21333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432849.131006:0:21333:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787432849.131012:0:21333:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff94830347b000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787432849.131018:0:21333:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff94830268cd28) has exports, disconnecting them 00000020:00080000:1.0:1787432849.131022:0:21333:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff94830347b000), last request at 1787432770 00000020:00000080:1.0:1787432849.131026:0:21333:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33564006c 00000020:00080000:1.0:1787432849.131038:0:21333:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94830347b000): rc 0 00000020:00000080:1.0:1787432849.131042:0:21333:0:(genops.c:885:class_export_put()) final put ffff94830347b000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787432849.131095:0:474:0:(genops.c:885:class_export_put()) final put ffff94840557c000/a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b 00000020:00000080:2.0:1787432849.131098:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff94840557c000/a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b for MGC192.168.204.124@tcp 00000020:01000000:2.0:1787432849.131113:0:474:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.124@tcp (a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b) 00000020:00000080:2.0:1787432849.131485:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff94830347b000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787432849.132218:0:21333:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787432849.132223:0:21333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787432849.132226:0:21333:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787432849.132231:0:21333:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787432849.132385:0:21333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432849.132392:0:21333:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1787432849.132398:0:21333:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787432849.132403:0:21333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432849.132407:0:21333:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787432849.132413:0:21333:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff948410640800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787432849.132419:0:21333:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff948433618000) has exports, disconnecting them 00000020:00080000:2.0:1787432849.132423:0:21333:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff948410640800), last request at 1787432770 00000020:00000080:2.0:1787432849.132427:0:21333:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b335640081 00000020:00080000:2.0:1787432849.132441:0:21333:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff948410640800): rc 0 00000020:00000080:2.0:1787432849.132444:0:21333:0:(genops.c:885:class_export_put()) final put ffff948410640800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1787432849.132612:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94830347d800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787432849.132619:0:8:0:(genops.c:885:class_export_put()) final put ffff9483045f6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787432849.132623:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9483045f6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787432849.132636:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787432849.132706:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948410640800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1787432849.201706:0:21333:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787432849.201715:0:21333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787432849.201720:0:21333:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787432849.201727:0:21333:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787432849.221054:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843c7f6800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1787432849.225298:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787432849.225520:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787432849.225621:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787432849.225721:0:17137:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff948406c95800:17137] 0 exiting: rc = 1 00000100:00100000:2.0:1787432849.225782:0:17138:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff948406c94000:17138] 1 exiting: rc = 0 00000100:00100000:2.0:1787432849.225837:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.236324:0:17141:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff948420e90800:17141] 2 exiting: rc = 0 00000100:00100000:3.0:1787432849.238749:0:17140:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9484358ee400:17140] 1 exiting: rc = 0 00000100:00100000:2.0:1787432849.254358:0:17139:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9484358eee00:17139] 0 exiting: rc = 1 00000100:00100000:1.0:1787432849.256824:0:18685:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9483045c9400:18685] 3 exiting: rc = 0 00000100:00100000:2.0:1787432849.259716:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259728:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259746:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259753:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259758:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259766:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259770:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259776:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259781:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259786:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259791:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259797:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259802:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259806:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259811:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259815:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259821:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259827:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259834:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259840:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259846:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259851:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259856:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259862:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259867:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259872:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259877:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259882:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259888:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259893:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259898:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259903:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259909:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259914:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259919:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259923:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259928:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259943:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259948:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259954:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259959:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259964:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259970:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259975:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259980:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259985:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259991:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.259996:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260001:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260006:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260011:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260017:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260022:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260028:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260033:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260038:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260043:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260048:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260053:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260059:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260064:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260070:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260076:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.260081:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787432849.261383:0:21333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432849.261394:0:21333:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1787432849.261399:0:21333:0:(genops.c:885:class_export_put()) final put ffff9483027d5000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1787432849.261403:0:21333:0:(genops.c:844:class_export_destroy()) destroying export ffff9483027d5000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1787432849.261409:0:21333:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1787432849.261459:0:21333:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948301d52800 1 00000020:00000080:2.0:1787432849.261464:0:21333:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b335640026 00000020:00000080:2.0:1787432849.261479:0:21333:0:(genops.c:885:class_export_put()) final put ffff948301e04800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787432849.261499:0:21333:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787432849.261503:0:21333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432849.261508:0:21333:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787432849.261512:0:21333:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff948302688000) has no exports 00000020:00000080:0.0:1787432849.262220:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948301e04800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787432849.309971:0:21333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432849.309988:0:21333:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787432849.309995:0:21333:0:(genops.c:885:class_export_put()) final put ffff948427f80000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787432849.309999:0:21333:0:(genops.c:844:class_export_destroy()) destroying export ffff948427f80000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787432849.310013:0:21333:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787432849.311020:0:21333:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff948427f84000 00000020:01000000:3.0:1787432849.311107:0:21333:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787432849.311114:0:21333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787432849.311119:0:21333:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787432849.311123:0:21333:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9484093b3370) has no exports 00000020:00000080:3.0:1787432849.311161:0:21333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432849.311266:0:21333:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787432849.311270:0:21333:0:(genops.c:885:class_export_put()) final put ffff9484337c2800/OSS_uuid 00000020:00000080:3.0:1787432849.311273:0:21333:0:(genops.c:844:class_export_destroy()) destroying export ffff9484337c2800/OSS_uuid for OSS 00000020:01000000:3.0:1787432849.311277:0:21333:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787432849.311651:0:19127:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff94843bc27600:19127] 3 exiting: rc = 0 00000100:00100000:3.0:1787432849.311774:0:18660:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9484059a5e00:18660] 1 exiting: rc = 0 00000100:00100000:0.0:1787432849.311776:0:18659:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff94843c7e7e00:18659] 0 exiting: rc = 1 00000100:00080000:1.0:1787432849.311831:0:17150:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787432849.312063:0:18661:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9484059a5000:18661] 2 exiting: rc = 0 00000100:00100000:2.0:1787432849.312295:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312304:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312309:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312319:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312325:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312331:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312336:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312341:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312346:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312351:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312357:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312362:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312367:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312377:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312385:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312391:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312397:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312402:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312410:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312416:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312421:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312427:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312447:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312453:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312458:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312464:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312469:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312475:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312480:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312495:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312501:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312506:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312511:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312517:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312522:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312526:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312532:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312537:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312546:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312552:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312678:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312685:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312690:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312695:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312700:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312714:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312725:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312731:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312737:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312742:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312749:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312753:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312759:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312764:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312769:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312774:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312784:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312790:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312796:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312802:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312807:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312812:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312818:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.312823:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432849.315704:0:18662:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9484059a4600:18662] 0 exiting: rc = 1 00000100:00100000:0.0:1787432849.315815:0:18663:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9484059a4200:18663] 1 exiting: rc = 0 00000100:00100000:2.0:1787432849.316005:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316013:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316019:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316025:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316030:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316036:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316042:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316048:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316053:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316065:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316070:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316076:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316081:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316086:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316092:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316097:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316102:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316107:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316112:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316117:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316122:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316127:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316132:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316138:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316143:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316148:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316153:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316159:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316326:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316333:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316338:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316343:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316348:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316353:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316358:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316377:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316381:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316386:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316391:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316396:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316401:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316406:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316411:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316416:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316421:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316427:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316433:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316438:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316442:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316447:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316452:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316456:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316461:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316465:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316471:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316477:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316481:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316486:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316492:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316497:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316501:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316506:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316511:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.316517:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432849.317663:0:18665:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff94843f8d8200:18665] 1 exiting: rc = 0 00000100:00100000:1.0:1787432849.317952:0:18666:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff94843b395800:18666] 2 exiting: rc = 0 00000100:00100000:0.0:1787432849.318835:0:18664:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff94843f8d8000:18664] 0 exiting: rc = 1 00000100:00100000:2.0:1787432849.318953:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.318960:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.318976:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.318986:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.318992:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.318998:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319014:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319021:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319027:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319033:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319039:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319053:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319061:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319066:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319071:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319077:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319082:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319087:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319092:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319098:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319103:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319109:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319114:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319120:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319126:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319132:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319139:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319144:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319149:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319155:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319159:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319182:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319188:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319193:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319198:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319218:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319224:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319230:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319235:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319240:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319245:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319256:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319260:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319267:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319273:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319279:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319285:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319291:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319298:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319303:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319309:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319317:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319324:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319329:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319336:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319341:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319347:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319353:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319359:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319364:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319379:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319385:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319390:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.319395:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432849.323509:0:18668:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff948434d93000:18668] 1 exiting: rc = 0 00000100:00100000:1.0:1787432849.323713:0:18667:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff948436089a00:18667] 0 exiting: rc = 1 00000100:00100000:2.0:1787432849.323829:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323835:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323839:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323843:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323847:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323851:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323853:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323857:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323860:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323863:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323867:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323871:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323884:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323887:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323890:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323894:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323897:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323903:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323908:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323913:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323917:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323923:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323927:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323932:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323938:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323943:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323948:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323953:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323958:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323964:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323969:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323974:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323980:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323986:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323991:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.323995:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324000:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324005:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324010:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324015:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324021:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324027:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324031:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324037:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324042:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324048:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324054:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324066:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324071:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324077:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324082:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324087:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324092:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324097:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324102:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324107:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324111:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324117:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324122:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324128:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324133:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324137:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324142:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.324146:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432849.324967:0:18670:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff94842e976c00:18670] 1 exiting: rc = 0 00000100:00100000:0.0:1787432849.325097:0:18669:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff94843b28fc00:18669] 0 exiting: rc = 1 00000100:00100000:2.0:1787432849.325330:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325336:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325351:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325377:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325384:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325390:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325395:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325402:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325408:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325414:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325420:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325426:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325433:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325438:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325446:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325468:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325475:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325481:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325497:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325503:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325509:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325514:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325519:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325525:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325530:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325536:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325541:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325635:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325643:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325649:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325654:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325659:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325674:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325681:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325686:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325691:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325697:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325702:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325708:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325726:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325733:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325739:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325745:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325751:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325757:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325763:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325769:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325774:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325780:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325785:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325790:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325806:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325813:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325824:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325829:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325835:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325840:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325846:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325851:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325856:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325862:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325867:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325873:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432849.325887:0:21333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787432849.333120:0:21333:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787432871.949190:0:22099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787432882.181140:0:22698:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787432882.181147:0:22698:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787432882.181149:0:22698:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787432882.181292:0:22698:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94844112f000 00000020:01000004:0.0:1787432882.181858:0:22698:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787432882.181867:0:22698:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787432882.181883:0:22698:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff94843361b370) 00000020:00000080:0.0:1787432882.181899:0:22698:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787432882.254558:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787432882.254977:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787432882.260626:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1787432882.261101:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787432882.261822:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787432882.262355:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787432882.262776:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787432882.262968:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787432882.263639:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787432882.263856:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787432882.264367:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787432882.265002:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787432882.265386:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787432882.265693:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787432882.266709:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1787432882.267008:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787432882.267398:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1787432882.267650:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1787432882.267951:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787432882.268265:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787432882.269283:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787432882.269838:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787432882.270423:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787432882.270695:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787432882.271051:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787432882.271384:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787432882.272679:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1787432882.273500:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787432882.273862:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1787432882.274268:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1787432882.274586:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787432882.274928:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787432882.275543:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787432882.276077:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787432882.276456:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787432882.276853:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787432882.279443:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1787432882.280012:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1787432882.285915:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1787432882.286776:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787432882.287503:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1787432882.287836:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1787432882.288489:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1787432882.289890:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787432882.290461:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1787432882.290803:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787432882.294927:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1787432882.296675:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1787432882.297737:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1787432882.298045:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1787432882.298895:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1787432882.299272:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1787432882.299596:0:22698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:0.0:1787432882.300793:0:22698:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787432882.301708:0:22698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787432882.301820:0:22698:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787432882.301834:0:22698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b3356404cc 00000020:01000004:0.0:1787432882.301841:0:22698:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787432882.301846:0:22698:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787432882.301852:0:22698:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94844112f000 from MGS 00000020:01000004:0.0:1787432882.301855:0:22698:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787432882.301867:0:22698:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff948433618000) 00000020:00000080:0.0:1787432882.301934:0:22698:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787432882.301993:0:22698:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94844112f000 from MGS, refs=2 00080000:01000000:0.0:1787432882.301998:0:22698:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787432882.302002:0:22698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b3356404da 00000100:00100000:0.0:1787432882.302322:0:22698:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787432882.302455:0:22698:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787432882.302461:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787432882.303655:0:22698:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787432882.303667:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787432882.318193:0:22698:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787432882.318398:0:22698:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787432882.318405:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787432882.329655:0:22698:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787432882.329671:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787432882.331213:0:22698:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787432882.331225:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787432882.332458:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432882.332463:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432882.332465:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432882.332724:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432882.332727:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432882.332728:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432882.333396:0:22698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787432882.335688:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787432882.351430:0:22698:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787432882.353138:0:22710:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787432882.353211:0:22698:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787432882.353258:0:22698:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787432882.354130:0:22698:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787432882.354488:0:22698:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432882.356059:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787432882.356067:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787432882.358227:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787432882.358239:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787432882.358845:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787432882.358918:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787432882.359984:0:22698:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787432882.360007:0:22698:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.124@tcp' 00000020:01000004:2.0:1787432882.360008:0:22698:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787432882.360051:0:22698:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.124@tcp (typ=mgc) 00000020:00000080:2.0:1787432882.360062:0:22698:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.124@tcp (ffff94843b95cd28) 00000020:00000080:2.0:1787432882.360077:0:22698:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787432882.360192:0:22698:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94842d4d5000@MGC192.168.204.124@tcp: add connection 192.168.204.124@tcp at head 00010000:00010000:2.0:1787432882.360351:0:22698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.124@tcp-0 is initialized 00000040:01000000:2.0:1787432882.360357:0:22698:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.124@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787432882.361066:0:22715:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787432882.361960:0:22716:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787432882.362029:0:22698:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.124@tcp (uuid 3a13c04c-dd5b-4f06-b031-814868f35d81) 00000020:00000080:3.0:1787432882.362052:0:22698:0:(genops.c:1385:class_connect()) connect: client 3a13c04c-dd5b-4f06-b031-814868f35d81, cookie 0xca72b3b3356404e8 00000100:00080000:3.0:1787432882.362066:0:22698:0:(import.c:510:import_select_connection()) MGC192.168.204.124@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787432882.362072:0:22698:0:(import.c:624:import_select_connection()) MGC192.168.204.124@tcp: import ffff94842d4d5000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432882.362105:0:22698:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948403568700 x1874258609541888/t0(0) o250->MGC192.168.204.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432882.362154:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3a13c04c-dd5b-4f06-b031-814868f35d81:3640:1874258609541888:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787432882.362238:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432882.365192:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609541888 00000100:00100000:3.0:1787432882.365205:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609541888 00000100:00100000:3.0:1787432882.365245:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432882.365254:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1874258609541888:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1787432882.365293:0:22711:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3a13c04c-dd5b-4f06-b031-814868f35d81@0@lo t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:3.0:1787432882.365323:0:22711:0:(genops.c:1385:class_connect()) connect: client 3a13c04c-dd5b-4f06-b031-814868f35d81, cookie 0xca72b3b3356404ef 00000100:00080000:3.0:1787432882.365458:0:22711:0:(import.c:65:import_set_state_nolock()) ffff948304f0d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432882.365539:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+5:3640:x1874258609541888:12345-0@lo:250:mount.lustre.0 Request processed in 285us (3301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432882.365548:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787432882.365581:0:22698:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3a13c04c-dd5b-4f06-b031-814868f35d81->MGS 00000020:01000004:3.0:1787432882.365600:0:22698:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787432882.365605:0:22698:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787432882.365618:0:22698:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9484093b3370) 00000020:00000080:3.0:1787432882.365628:0:22698:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787432882.369586:0:3640:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.124@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787432882.369603:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.124@tcp: connect to target with instance 0 00000100:00080000:1.0:1787432882.369612:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.124@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787432882.369618:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787432882.369622:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94842d4d5000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787432882.369626:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787432882.369643:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787432882.369653:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3a13c04c-dd5b-4f06-b031-814868f35d81:3640:1874258609541888:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787432882.376118:0:22698:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432882.376717:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787432882.376725:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787432882.377764:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787432882.377774:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787432882.378092:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787432882.378098:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787432882.378928:0:22698:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432882.379446:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787432882.379452:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787432882.379931:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787432882.379937:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787432882.424259:0:22698:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432882.425098:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787432882.425110:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787432882.428428:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787432882.428449:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787432882.431935:0:22698:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432882.432534:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787432882.432541:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787432882.433292:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787432882.433301:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787432882.434074:0:22698:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432882.434633:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787432882.434639:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787432882.435559:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787432882.435570:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787432882.436531:0:22698:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432882.436705:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787432882.436710:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787432882.441706:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787432882.441743:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787432882.467604:0:22698:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432882.467836:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787432882.467844:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787432882.470345:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787432882.470359:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787432882.471993:0:22698:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787432882.472008:0:22698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787432882.473276:0:22698:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787432882.473307:0:22698:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787432882.473314:0:22698:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.124@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787432882.473444:0:22698:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.124@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787432882.473481:0:22698:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.124@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787432882.473485:0:22698:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787432882.473487:0:22698:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787432882.473488:0:22698:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432882.473489:0:22698:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432882.473490:0:22698:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432882.473492:0:22698:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432882.473493:0:22698:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432882.473495:0:22698:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787432882.473497:0:22698:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432882.473498:0:22698:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787432882.473501:0:22698:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787432882.473507:0:22698:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787432882.473508:0:22698:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787432882.473509:0:22698:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432882.473510:0:22698:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432882.473511:0:22698:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432882.473512:0:22698:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432882.473513:0:22698:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432882.473514:0:22698:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787432882.473515:0:22698:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432882.473516:0:22698:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787432882.473543:0:22698:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787432882.473567:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609542016:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787432882.473669:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432882.473719:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483047436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432882.473918:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609542016 00000100:00100000:0.0:1787432882.473927:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609542016 00000100:00100000:0.0:1787432882.474236:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432882.474249:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+5:22698:x1874258609542016:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787432882.474308:0:22714:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787432882.474311:0:22714:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787432882.474315:0:22714:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787432882.474868:0:22734:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787432882.475595:0:22714:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1787432882.477531:0:22735:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787432882.477539:0:22735:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1787432882.477543:0:22735:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787432882.477546:0:22735:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787432882.477769:0:22735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1787432882.478698:0:22714:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787432882.478720:0:22714:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787432882.481630:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+5:22698:x1874258609542016:12345-0@lo:253:mount.lustre.0 Request processed in 7374us (7951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432882.481651:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432882.481948:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609542016:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787432882.481963:0:22698:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787432882.481975:0:22698:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787432882.481977:0:22698:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787432882.481979:0:22698:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432882.481980:0:22698:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432882.481981:0:22698:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432882.481982:0:22698:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432882.481984:0:22698:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787432882.481985:0:22698:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787432882.481987:0:22698:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432882.481989:0:22698:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787432882.482024:0:22698:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94844112f000 from lustre-MDT0000 10000000:01000000:1.0:1787432882.482059:0:22698:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787432882.482062:0:22698:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787432882.482066:0:22698:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff94843b95cd28 10000000:01000000:1.0:1787432882.482071:0:22698:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787432882.482079:0:22698:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94843b95cd28 from 1 10000000:01000000:1.0:1787432882.482082:0:22698:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787432882.482310:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.482324:0:22698:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.482334:0:22698:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432882.482354:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609542144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787432882.482400:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432882.482432:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432882.482890:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609542144 00000100:00100000:2.0:1787432882.482898:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609542144 00000100:00100000:2.0:1787432882.482991:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787432882.483004:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+5:22698:x1874258609542144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432882.483028:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432882.483048:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948301f04800/0xca72b3b335640504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b3356404fd expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432882.483077:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948301f04800/0xca72b3b335640504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b3356404fd expref: 6 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432882.483086:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948301f04800/0xca72b3b335640504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356404fd expref: 6 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432882.483110:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f04800, rc 0) 00000100:00100000:2.0:1787432882.483195:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+6:22698:x1874258609542144:12345-0@lo:101:mount.lustre.0 Request processed in 194us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432882.483202:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432882.483287:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609542144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432882.483315:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640504 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.483332:0:22698:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640504 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432882.483398:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609542272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432882.483428:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432882.484040:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432882.484318:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609542272 00000100:00100000:0.0:1787432882.484326:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609542272 00000100:00100000:0.0:1787432882.484359:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432882.484368:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+6:22698:x1874258609542272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432882.484464:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+6:22698:x1874258609542272:12345-0@lo:501:mount.lustre.0 Request processed in 97us (1035us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787432882.484471:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432882.484566:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609542272:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787432882.484604:0:22698:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787432882.484628:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640504 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.484637:0:22698:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640504 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432882.484648:0:22698:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94844112f000 10000000:01000000:1.0:1787432882.484653:0:22698:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787432882.484658:0:22698:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff94844112f000 10000000:01000000:1.0:1787432882.484661:0:22698:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787432882.484666:0:22698:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff94844112f000 from 1 10000000:01000000:1.0:1787432882.484668:0:22698:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787432882.484701:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302691200/0xca72b3b33564050b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.484721:0:22698:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948302691200/0xca72b3b33564050b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.484749:0:22698:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948302691200/0xca72b3b33564050b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432882.484768:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609542400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787432882.484799:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432882.484820:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432882.485062:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609542400 00000100:00100000:0.0:1787432882.485066:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609542400 00000100:00100000:0.0:1787432882.485090:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432882.485097:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+6:22698:x1874258609542400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432882.485125:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432882.485145:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fc800/0xca72b3b335640512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33564050b expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432882.485200:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fc800/0xca72b3b335640512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33564050b expref: 7 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432882.485212:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fc800/0xca72b3b335640512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564050b expref: 7 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432882.485222:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fc800, rc 0) 00000100:00100000:0.0:1787432882.485254:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+7:22698:x1874258609542400:12345-0@lo:101:mount.lustre.0 Request processed in 157us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432882.485260:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787432882.485405:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609542400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432882.485419:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948302691200/0xca72b3b33564050b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640512 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.485427:0:22698:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948302691200/0xca72b3b33564050b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640512 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432882.485440:0:22698:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787432882.485455:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302691200/0xca72b3b33564050b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640512 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.485462:0:22698:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948302691200/0xca72b3b33564050b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640512 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432882.485468:0:22698:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787432882.485472:0:22698:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787432882.485476:0:22698:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff94844112f000 10000000:01000000:1.0:1787432882.485479:0:22698:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787432882.485482:0:22698:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787432882.485484:0:22698:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787432882.485500:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302691600/0xca72b3b335640519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.485517:0:22698:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948302691600/0xca72b3b335640519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.485525:0:22698:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948302691600/0xca72b3b335640519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432882.485538:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609542528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787432882.485578:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432882.485599:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432882.485723:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609542528 00000100:00100000:2.0:1787432882.485728:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609542528 00000100:00100000:2.0:1787432882.485757:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432882.485765:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+7:22698:x1874258609542528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432882.485772:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432882.485782:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948301f04400/0xca72b3b335640520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b335640519 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432882.485798:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948301f04400/0xca72b3b335640520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b335640519 expref: 8 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432882.485805:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948301f04400/0xca72b3b335640520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b335640519 expref: 8 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432882.485811:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f04400, rc 0) 00000100:00100000:2.0:1787432882.485852:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+8:22698:x1874258609542528:12345-0@lo:101:mount.lustre.0 Request processed in 88us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432882.485858:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787432882.486011:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609542528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432882.486033:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948302691600/0xca72b3b335640519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640520 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.486040:0:22698:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948302691600/0xca72b3b335640519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640520 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432882.486091:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609542656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432882.486274:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432882.486297:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432882.486380:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609542656 00000100:00100000:0.0:1787432882.486385:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609542656 00000100:00100000:0.0:1787432882.486407:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787432882.486414:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+8:22698:x1874258609542656:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432882.486542:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+9:22698:x1874258609542656:12345-0@lo:501:mount.lustre.0 Request processed in 129us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432882.486548:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432882.486654:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609542656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432882.486701:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609542784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432882.486752:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432882.486768:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432882.486885:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609542784 00000100:00100000:0.0:1787432882.486888:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609542784 00000100:00100000:0.0:1787432882.486901:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787432882.486906:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+9:22698:x1874258609542784:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432882.487852:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+9:22698:x1874258609542784:12345-0@lo:503:mount.lustre.0 Request processed in 942us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432882.487871:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787432882.488043:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609542784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432882.488813:0:22736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a13c04c-dd5b-4f06-b031-814868f35d81:22736:1874258609542912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432882.488865:0:22736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432882.488903:0:22736:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978000 going to sleep for 11 seconds 00000100:00100000:2.0:1787432882.488964:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609542912 00000100:00100000:2.0:1787432882.489045:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609542912 00000100:00100000:2.0:1787432882.489213:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787432882.489225:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+9:22736:x1874258609542912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432882.490424:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+9:22736:x1874258609542912:12345-0@lo:502:llog_process_th.0 Request processed in 1197us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432882.490444:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787432882.490523:0:22736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a13c04c-dd5b-4f06-b031-814868f35d81:22736:1874258609542912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787432882.490625:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432882.490637:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.490640:0:22736:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787432882.490647:0:22736:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787432882.490650:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787432882.490665:0:22736:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff94843361cd28) 00000020:00000080:0.0:1787432882.490683:0:22736:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787432882.490689:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787432882.490888:0:22736:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787432882.490896:0:22736:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33564052e 00000020:00000080:0.0:1787432882.491722:0:22736:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787432882.491731:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432882.491737:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.491739:0:22736:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787432882.491742:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432882.491747:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.491748:0:22736:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787432882.491752:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787432882.491762:0:22736:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9484336199b8) 00000020:00000080:0.0:1787432882.491775:0:22736:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787432882.491779:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787432882.491781:0:22736:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787432882.491784:0:22736:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787432882.491790:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787432882.491852:0:22736:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94844112f000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787432882.492402:0:22736:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9483030f0000) 00000020:00000080:0.0:1787432882.492413:0:22736:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787432882.492493:0:22736:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787432882.492500:0:22736:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b335640543 00000020:00000080:0.0:1787432882.492809:0:22736:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787432882.492817:0:22736:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787432882.492822:0:22736:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xca72b3b33564054a 00080000:01000000:0.0:1787432882.492828:0:22736:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787432882.492833:0:22736:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b335640551 00010000:00010000:2.0:1787432882.590287:0:22736:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787432882.590832:0:22736:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1787432882.591292:0:22736:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787432882.591830:0:22736:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff94843b958000) 00000020:00000080:2.0:1787432882.591850:0:22736:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787432882.591941:0:22736:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787432882.591948:0:22736:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33564055f 00000020:00000080:1.0:1787432882.592641:0:22736:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787432882.597310:0:22736:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xca72b3b335640566 00000020:00000080:0.0:1787432882.601033:0:22736:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787432882.601049:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432882.601055:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.601057:0:22736:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787432882.601060:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787432882.601063:0:22736:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1787432882.601065:0:22736:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787432882.601066:0:22736:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787432882.601068:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787432882.601070:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.601071:0:22736:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787432882.601074:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432882.601079:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.601080:0:22736:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787432882.601086:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787432882.601149:0:22736:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787432882.601187:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432882.601190:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.601192:0:22736:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787432882.601195:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432882.601197:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.601199:0:22736:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787432882.601201:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787432882.601207:0:22736:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:00000080:0.0:1787432882.601234:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787432882.601252:0:22736:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9483030f4d28) 00000020:00000080:0.0:1787432882.601270:0:22736:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787432882.601274:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787432882.601349:0:22736:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787432882.601355:0:22736:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787432882.601361:0:22736:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b335640574 00010000:00080000:0.0:1787432882.601390:0:22736:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94843f86d800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.124@tcp at head 00010000:00010000:0.0:1787432882.611856:0:22736:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1787432882.614587:0:22736:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787432882.614606:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787432882.614647:0:22736:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787432882.614906:0:22736:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b33564057b 00000100:00080000:0.0:1787432882.614919:0:22736:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787432882.614926:0:22736:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94843f86d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432882.615048:0:22736:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948434899880 x1874258609543040/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787432882.615135:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609543040:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787432882.615247:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432882.615383:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609543040 00000100:00100000:3.0:1787432882.615391:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609543040 00000100:00100000:3.0:1787432882.615425:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432882.615441:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874258609543040:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1787432882.615457:0:22723:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1787432882.616499:0:22736:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1787432882.616593:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432882.616601:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.616603:0:22736:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787432882.616607:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787432882.616610:0:22736:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1787432882.616612:0:22736:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787432882.616613:0:22736:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787432882.616615:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787432882.616617:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.616619:0:22736:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787432882.616622:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787432882.616627:0:22736:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787432882.616630:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.616632:0:22736:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787432882.616634:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787432882.616638:0:22736:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:01000000:0.0:1787432882.616667:0:22736:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787432882.616678:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787432882.616695:0:22736:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9483030f3370) 00000020:00000080:0.0:1787432882.616715:0:22736:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787432882.616720:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787432882.617009:0:22736:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787432882.617025:0:22736:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787432882.617032:0:22736:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b335640589 00010000:00080000:0.0:1787432882.617063:0:22736:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94843f868000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.124@tcp at head 00010000:00010000:0.0:1787432882.617446:0:22736:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787432882.623052:0:22736:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787432882.629053:0:22736:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787432882.641370:0:22736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432882.644051:0:22736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:3.0:1787432882.652474:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874258609543040:12345-0@lo:38:llog_process_th.0 Request processed in 37023us (37216us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787432882.652490:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787432882.652545:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843f86d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787432882.652550:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787432882.652554:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609543040:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787432882.653059:0:22736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000020:00000080:1.0:1787432882.655911:0:22736:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787432882.655928:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787432882.655969:0:22736:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787432882.656002:0:22736:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b335640590 00000100:00080000:1.0:1787432882.656021:0:22736:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787432882.656027:0:22736:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94843f868000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432882.656069:0:22736:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9483039b6680 x1874258609543168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787432882.656102:0:22736:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787432882.656369:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432882.656373:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432882.656375:0:22736:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787432882.656378:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787432882.656380:0:22736:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1787432882.656381:0:22736:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787432882.656383:0:22736:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787432882.656384:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787432882.656387:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432882.656388:0:22736:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787432882.656391:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787432882.656394:0:22736:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787432882.656398:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432882.656399:0:22736:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787432882.656416:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787432882.656421:0:22736:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:01000000:1.0:1787432882.656446:0:22736:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787432882.656449:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432882.656463:0:22736:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9483026899b8) 00000020:00000080:1.0:1787432882.656477:0:22736:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787432882.656482:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787432882.656542:0:22736:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787432882.656548:0:22736:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787432882.656554:0:22736:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33564059e 00010000:00080000:1.0:1787432882.656582:0:22736:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948304f08000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.124@tcp at head 00000100:00100000:0.0:1787432882.656807:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609543168:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787432882.656860:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609543168 offset 0 length 520: 4 00010000:00010000:1.0:1787432882.657066:0:22736:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787432882.657362:0:22736:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787432882.657380:0:22736:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787432882.659129:0:22743:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787432882.659138:0:22743:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1787432882.664331:0:22736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432882.664771:0:22736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1787432882.664937:0:22736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1787432882.666269:0:22745:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787432882.666275:0:22745:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787432882.671862:0:22736:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787432882.671884:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787432882.671947:0:22736:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787432882.672447:0:22736:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b3356405a5 00000100:00080000:0.0:1787432882.672461:0:22736:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787432882.672468:0:22736:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948304f08000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432882.672505:0:22736:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948434898380 x1874258609543296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432882.672640:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609543296:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787432882.672832:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609543296 offset 0 length 520: 4 00000100:00080000:0.0:1787432882.672892:0:22736:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787432882.672989:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432882.672995:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.672997:0:22736:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787432882.673000:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432882.673004:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.673005:0:22736:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787432882.673008:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787432882.673021:0:22736:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787432882.673024:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432882.673041:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.673043:0:22736:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787432882.673046:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432882.673049:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.673050:0:22736:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787432882.673054:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787432882.673086:0:22736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a13c04c-dd5b-4f06-b031-814868f35d81:22736:1874258609543424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432882.673147:0:22736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432882.673203:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609543424 00000100:00100000:0.0:1787432882.673209:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609543424 00000100:00100000:0.0:1787432882.673247:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432882.673256:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+9:22736:x1874258609543424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432882.673372:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+9:22736:x1874258609543424:12345-0@lo:502:llog_process_th.0 Request processed in 117us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432882.673381:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432882.673422:0:22736:0:(client.c:2715:ptlrpc_set_wait()) set ffff948409846b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432882.673440:0:22736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a13c04c-dd5b-4f06-b031-814868f35d81:22736:1874258609543424:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787432882.673463:0:22736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432882.673467:0:22736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.673468:0:22736:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787432882.673471:0:22736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787432882.673979:0:22698:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1787432882.674019:0:22698:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787432882.674044:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302691600/0xca72b3b335640519 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640520 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432882.674055:0:22698:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948302691600/0xca72b3b335640519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640520 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432882.674064:0:22698:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94844112f000 from 1 10000000:01000000:2.0:1787432882.674067:0:22698:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787432882.674106:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f04000/0xca72b3b3356405ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432882.674124:0:22698:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948301f04000/0xca72b3b3356405ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432882.674146:0:22698:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948301f04000/0xca72b3b3356405ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432882.674192:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609543552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787432882.674232:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432882.674264:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432882.674409:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609543552 00000100:00100000:1.0:1787432882.674415:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609543552 00000100:00100000:1.0:1787432882.674455:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787432882.674465:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+9:22698:x1874258609543552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432882.674474:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432882.674488:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302690600/0xca72b3b3356405b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b3356405ac expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.674516:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302690600/0xca72b3b3356405b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b3356405ac expref: 10 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.674527:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302690600/0xca72b3b3356405b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356405ac expref: 10 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.674547:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302690600, rc 0) 00000100:00100000:1.0:1787432882.674580:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+10:22698:x1874258609543552:12345-0@lo:101:mount.lustre.0 Request processed in 117us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432882.674587:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432882.674854:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609543552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432882.674868:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948301f04000/0xca72b3b3356405ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356405b3 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432882.674877:0:22698:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948301f04000/0xca72b3b3356405ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b3356405b3 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432882.675682:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609543680:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787432882.675939:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432882.676032:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432882.676414:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609543680 00000100:00100000:0.0:1787432882.676423:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609543680 00000100:00100000:0.0:1787432882.676499:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787432882.676517:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+10:22698:x1874258609543680:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787432882.676536:0:22712:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787432882.676542:0:22712:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787432882.676832:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+10:22698:x1874258609543680:12345-0@lo:256:mount.lustre.0 Request processed in 324us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432882.676854:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432882.676930:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609543680:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787432882.677515:0:22698:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787432882.677543:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f04000/0xca72b3b3356405ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356405b3 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432882.677555:0:22698:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948301f04000/0xca72b3b3356405ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356405b3 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432882.677564:0:22698:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94844112f000 from 1 10000000:01000000:2.0:1787432882.677567:0:22698:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787432882.677610:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f05400/0xca72b3b3356405ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432882.677618:0:22698:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948301f05400/0xca72b3b3356405ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432882.677627:0:22698:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948301f05400/0xca72b3b3356405ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432882.677645:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609543808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787432882.677695:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432882.678444:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432882.678543:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609543808 00000100:00100000:1.0:1787432882.678552:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609543808 00000100:00100000:1.0:1787432882.678592:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432882.678601:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+10:22698:x1874258609543808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432882.678615:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432882.678632:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302690c00/0xca72b3b3356405c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b3356405ba expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.678668:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302690c00/0xca72b3b3356405c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b3356405ba expref: 11 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.678682:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302690c00/0xca72b3b3356405c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356405ba expref: 11 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.678693:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302690c00, rc 0) 00000100:00100000:1.0:1787432882.678756:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+11:22698:x1874258609543808:12345-0@lo:101:mount.lustre.0 Request processed in 156us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432882.678763:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432882.679006:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609543808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432882.679029:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948301f05400/0xca72b3b3356405ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356405c1 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432882.679037:0:22698:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948301f05400/0xca72b3b3356405ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b3356405c1 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432882.679110:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609543936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432882.679154:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432882.679194:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432882.679363:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609543936 00000100:00100000:1.0:1787432882.679369:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609543936 00000100:00100000:1.0:1787432882.679393:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787432882.679399:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+11:22698:x1874258609543936:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432882.679548:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+11:22698:x1874258609543936:12345-0@lo:501:mount.lustre.0 Request processed in 148us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432882.679568:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432882.679814:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609543936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432882.679846:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609544064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787432882.679887:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432882.679918:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432882.680040:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609544064 00000100:00100000:1.0:1787432882.680045:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609544064 00000100:00100000:1.0:1787432882.680066:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432882.680073:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+11:22698:x1874258609544064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432882.680399:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+11:22698:x1874258609544064:12345-0@lo:503:mount.lustre.0 Request processed in 325us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432882.680406:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787432882.680638:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609544064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432882.681484:0:22747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a13c04c-dd5b-4f06-b031-814868f35d81:22747:1874258609544192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432882.681542:0:22747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432882.681576:0:22747:0:(client.c:2715:ptlrpc_set_wait()) set ffff948409846780 going to sleep for 11 seconds 00000100:00100000:1.0:1787432882.681687:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609544192 00000100:00100000:1.0:1787432882.681692:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609544192 00000100:00100000:1.0:1787432882.681739:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787432882.681748:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+11:22747:x1874258609544192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432882.682422:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+11:22747:x1874258609544192:12345-0@lo:502:llog_process_th.0 Request processed in 674us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432882.682431:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787432882.682533:0:22747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a13c04c-dd5b-4f06-b031-814868f35d81:22747:1874258609544192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432882.682563:0:22747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432882.682572:0:22747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432882.682574:0:22747:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787432882.682581:0:22747:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94844112f000 00000020:00000080:2.0:1787432882.682583:0:22747:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787432882.682591:0:22747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432882.682593:0:22747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432882.682594:0:22747:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787432882.682596:0:22747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432882.682598:0:22747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432882.682600:0:22747:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787432882.682603:0:22747:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94844112f000 00000020:00000080:2.0:1787432882.682605:0:22747:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787432882.682676:0:22747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432882.682679:0:22747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432882.682681:0:22747:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787432882.682683:0:22747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432882.682685:0:22747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432882.682687:0:22747:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787432882.682690:0:22747:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94844112f000 00000020:00000080:2.0:1787432882.682692:0:22747:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787432882.684061:0:22747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432882.684071:0:22747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432882.684072:0:22747:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787432882.684076:0:22747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432882.684079:0:22747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432882.684080:0:22747:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787432882.684084:0:22747:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94844112f000 00000020:00000080:2.0:1787432882.684086:0:22747:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787432882.684182:0:22747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a13c04c-dd5b-4f06-b031-814868f35d81:22747:1874258609544320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432882.684256:0:22747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432882.684299:0:22747:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432882.685393:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609544320 00000100:00100000:0.0:1787432882.685404:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609544320 00000100:00100000:0.0:1787432882.685463:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787432882.685474:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+11:22747:x1874258609544320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432882.685634:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+11:22747:x1874258609544320:12345-0@lo:502:llog_process_th.0 Request processed in 161us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432882.685643:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787432882.685705:0:22747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a13c04c-dd5b-4f06-b031-814868f35d81:22747:1874258609544320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787432882.685751:0:22747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432882.685758:0:22747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432882.685760:0:22747:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787432882.685764:0:22747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787432882.695852:0:22698:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787432882.695897:0:22698:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787432882.695916:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f05400/0xca72b3b3356405ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356405c1 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.695928:0:22698:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948301f05400/0xca72b3b3356405ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356405c1 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432882.696053:0:22698:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787432882.696057:0:22698:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94844112f000 10000000:01000000:1.0:1787432882.696059:0:22698:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94844112f000 10000000:01000000:1.0:1787432882.696063:0:22698:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787432882.696075:0:22698:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94844112f000 from 1 10000000:01000000:1.0:1787432882.696078:0:22698:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787432882.696812:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302691a00/0xca72b3b3356405c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.696825:0:22698:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948302691a00/0xca72b3b3356405c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.696837:0:22698:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948302691a00/0xca72b3b3356405c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432882.696863:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609544448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787432882.696939:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432882.697458:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483033ffa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432882.698108:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609544448 00000100:00100000:0.0:1787432882.698128:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609544448 00000100:00100000:0.0:1787432882.698199:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787432882.698210:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+11:22698:x1874258609544448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432882.698226:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432882.698242:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fcc00/0xca72b3b3356405cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b3356405c8 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432882.698266:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fcc00/0xca72b3b3356405cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b3356405c8 expref: 12 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432882.698290:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fcc00/0xca72b3b3356405cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356405c8 expref: 12 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432882.698299:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fcc00, rc 0) 00000100:00100000:0.0:1787432882.698365:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22698:x1874258609544448:12345-0@lo:101:mount.lustre.0 Request processed in 158us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432882.698372:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787432882.700091:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609544448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432882.700280:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948302691a00/0xca72b3b3356405c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356405cf expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.700294:0:22698:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948302691a00/0xca72b3b3356405c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b3356405cf expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432882.700382:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609544576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432882.700443:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432882.703674:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483033ffa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432882.716107:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609544576 00000100:00100000:2.0:1787432882.716135:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609544576 00000100:00100000:2.0:1787432882.716208:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787432882.716220:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22698:x1874258609544576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432882.716404:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22698:x1874258609544576:12345-0@lo:501:mount.lustre.0 Request processed in 186us (15960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432882.716412:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787432882.717880:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609544576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432882.720236:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609544704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432882.720330:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432882.720375:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483033ffa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432882.721246:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609544704 00000100:00100000:2.0:1787432882.721258:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609544704 00000100:00100000:2.0:1787432882.721315:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787432882.721325:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22698:x1874258609544704:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787432882.721475:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22698:x1874258609544704:12345-0@lo:503:mount.lustre.0 Request processed in 151us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432882.721483:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787432882.724343:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609544704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432882.725337:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403569f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a13c04c-dd5b-4f06-b031-814868f35d81:22752:1874258609544832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432882.725414:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432882.725451:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432882.725500:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609544832 00000100:00100000:2.0:1787432882.725508:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609544832 00000100:00100000:2.0:1787432882.725557:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787432882.725567:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22752:x1874258609544832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432882.725690:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22752:x1874258609544832:12345-0@lo:502:llog_process_th.0 Request processed in 123us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432882.725698:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787432882.725849:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403569f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a13c04c-dd5b-4f06-b031-814868f35d81:22752:1874258609544832:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787432882.725910:0:22752:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787432882.725927:0:22752:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9484093b0000) 00000020:00000080:3.0:1787432882.725946:0:22752:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1787432882.730008:0:22752:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94844112f000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787432882.730029:0:22752:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94844112f000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787432882.730033:0:22752:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94844112f000 4 00010000:00080000:3.0:1787432882.730074:0:22752:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948301d50000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.124@tcp at head 00010000:00010000:3.0:1787432882.733277:0:22752:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1787432882.733515:0:22752:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787432882.733566:0:22752:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787432882.733580:0:22752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xca72b3b3356405dd 00000100:00080000:3.0:1787432882.733591:0:22752:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787432882.733597:0:22752:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff948301d50000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432882.733634:0:22752:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948403569f80 x1874258609544960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432882.738247:0:22752:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787432882.739099:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609544960:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787432882.739259:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432882.741348:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609544960 00000100:00100000:1.0:1787432882.741365:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609544960 00000100:00100000:1.0:1787432882.741408:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432882.741417:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874258609544960:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787432882.741520:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874258609544960:12345-0@lo:38:llog_process_th.0 Request processed in 103us (2262us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787432882.741528:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432882.741662:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787432882.741672:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948301d50000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432882.741677:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787432882.741682:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609544960:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787432882.742499:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403569f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a13c04c-dd5b-4f06-b031-814868f35d81:22752:1874258609545088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432882.742559:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432882.742593:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a03600 going to sleep for 11 seconds 00000100:00100000:3.0:1787432882.742609:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609545088 00000100:00100000:3.0:1787432882.742613:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609545088 00000100:00100000:3.0:1787432882.742647:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787432882.742654:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22752:x1874258609545088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432882.742791:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22752:x1874258609545088:12345-0@lo:502:llog_process_th.0 Request processed in 137us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432882.742798:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787432882.742845:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403569f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a13c04c-dd5b-4f06-b031-814868f35d81:22752:1874258609545088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432882.742882:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403569f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a13c04c-dd5b-4f06-b031-814868f35d81:22752:1874258609545216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432882.742911:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432882.742925:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a03600 going to sleep for 11 seconds 00000100:00100000:3.0:1787432882.742938:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609545216 00000100:00100000:3.0:1787432882.742941:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609545216 00000100:00100000:3.0:1787432882.742961:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787432882.742967:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22752:x1874258609545216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432882.748336:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22752:x1874258609545216:12345-0@lo:502:llog_process_th.0 Request processed in 5361us (5416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432882.748360:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787432882.748454:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403569f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a13c04c-dd5b-4f06-b031-814868f35d81:22752:1874258609545216:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787432882.748493:0:22752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787432882.748987:0:22698:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787432882.749502:0:22698:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787432882.749522:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302691a00/0xca72b3b3356405c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356405cf expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432882.749543:0:22698:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948302691a00/0xca72b3b3356405c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356405cf expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787432882.749597:0:22698:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787432882.749599:0:22698:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787432882.749600:0:22698:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432882.749601:0:22698:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432882.749603:0:22698:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432882.749605:0:22698:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432882.749606:0:22698:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432882.749608:0:22698:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787432882.749610:0:22698:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432882.749611:0:22698:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787432882.749615:0:22698:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787432882.749618:0:22698:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787432882.749619:0:22698:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787432882.749620:0:22698:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432882.749621:0:22698:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432882.749622:0:22698:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432882.749624:0:22698:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432882.749625:0:22698:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432882.749626:0:22698:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787432882.749627:0:22698:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432882.749628:0:22698:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787432882.749653:0:22698:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787432882.750215:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609545344:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787432882.750280:0:22698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432882.750318:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787432882.750690:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609545344 00000100:00100000:3.0:1787432882.750700:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609545344 00000100:00100000:3.0:1787432882.750755:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787432882.750764:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22698:x1874258609545344:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787432882.750793:0:22714:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787432882.750806:0:22714:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787432882.753379:0:22714:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787432882.753393:0:22714:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787432882.753478:0:22734:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787432882.753483:0:22734:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787432882.753505:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9484013fd400/0xca72b3b3356405e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432882.753523:0:22734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948302690600/0xca72b3b3356405b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356405ac expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432882.753530:0:22734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9484013fd400/0xca72b3b3356405e4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432882.753568:0:22734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948302690600/0xca72b3b3356405b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b3356405ac expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432882.753583:0:22734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948302690600/0xca72b3b3356405b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b3356405ac expref: 12 pid: 22714 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432882.753603:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22734:1874258609545472:0@lo:104: 00000100:00100000:0.0:1787432882.753682:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432882.753734:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff948409846240 going to sleep for 11 seconds 00000100:00100000:3.0:1787432882.755316:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22698:x1874258609545344:12345-0@lo:253:mount.lustre.0 Request processed in 4543us (5025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432882.755330:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787432882.755458:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:22698:1874258609545344:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787432882.755474:0:22698:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787432882.755478:0:22698:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787432882.755479:0:22698:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787432882.755481:0:22698:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432882.755491:0:22698:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432882.755492:0:22698:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432882.755494:0:22698:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432882.755495:0:22698:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432882.755497:0:22698:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787432882.755499:0:22698:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432882.755500:0:22698:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787432882.755518:0:22698:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787432882.757917:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609545472 00000100:00100000:1.0:1787432882.757932:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609545472 00000100:00100000:1.0:1787432882.758018:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432882.758030:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434898a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a13c04c-dd5b-4f06-b031-814868f35d81+3:22734:x1874258609545472:12345-0@lo:104: 00010000:00010000:1.0:1787432882.758047:0:22702:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948301f04000/0xca72b3b3356405ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356405b3 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.758154:0:22702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432882.758161:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434898a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a13c04c-dd5b-4f06-b031-814868f35d81+3:22734:x1874258609545472:12345-0@lo:104: Request processed in 135us (4479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432882.758184:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432882.758450:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22734:1874258609545472:0@lo:104: 00010000:00010000:0.0:1787432882.758474:0:22734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9484013fd400/0xca72b3b3356405e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432882.760401:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432882.760414:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948301f04000/0xca72b3b3356405ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356405b3 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432882.760424:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f04000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1787432882.760429:0:22708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948301f04000/0xca72b3b3356405ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b3356405b3 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432882.760438:0:22708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948301f04000/0xca72b3b3356405ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b3356405b3 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432882.760445:0:22708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948301f04000/0xca72b3b3356405ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b3356405b3 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432882.760471:0:22708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787432882.760524:0:22708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948301f04000/0xca72b3b3356405ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356405b3 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432882.760531:0:22708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432882.760571:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948301f04000/0xca72b3b3356405ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356405b3 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432882.760579:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948301f04000/0xca72b3b3356405ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356405b3 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432882.760601:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432882.760602:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432882.760604:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432882.761322:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a13c04c-dd5b-4f06-b031-814868f35d81:3642:1874258609545600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787432882.761403:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432882.761575:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609545600 00000100:00100000:1.0:1787432882.761584:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609545600 00010000:00010000:1.0:1787432882.761620:0:22704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948302690600/0xca72b3b3356405b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356405ac expref: 12 pid: 22714 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432882.761660:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432882.761670:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403568700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a13c04c-dd5b-4f06-b031-814868f35d81+12:3642:x1874258609545600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432882.761683:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432882.761699:0:22704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948302690600/0xca72b3b3356405b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356405ac expref: 12 pid: 22714 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.761711:0:22704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948302690600/0xca72b3b3356405b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b3356405ac expref: 12 pid: 22714 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.761727:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948302690600/0xca72b3b3356405b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b3356405ac expref: 12 pid: 22714 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.761743:0:22704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9484013fd400/0xca72b3b3356405e4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.761750:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fd400/0xca72b3b3356405e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787432882.761766:0:22704:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008283819s 00010000:00010000:1.0:1787432882.761770:0:22704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484013fd400/0xca72b3b3356405e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.761777:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484013fd400/0xca72b3b3356405e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.761784:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9484013fd400/0xca72b3b3356405e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.761790:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9484013fd400/0xca72b3b3356405e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.761795:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fd400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432882.761799:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9484013fd400/0xca72b3b3356405e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.761819:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9484013fd400/0xca72b3b3356405e4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.761833:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9484013fd400/0xca72b3b3356405e4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432882.761843:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432882.761883:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403568700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a13c04c-dd5b-4f06-b031-814868f35d81+11:3642:x1874258609545600:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432882.761891:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432882.761928:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a13c04c-dd5b-4f06-b031-814868f35d81:3642:1874258609545600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432882.763221:0:22734:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9484013fd400/0xca72b3b3356405e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432882.763234:0:22734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9484013fd400/0xca72b3b3356405e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432882.763242:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fd400/0xca72b3b3356405e4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787432882.782846:0:22698:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:1.0:1787432882.783133:0:22698:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787432882.783354:0:22759:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:0.0:1787432882.783358:0:22759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:2.0:1787432882.783474:0:22760:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787432882.783802:0:22760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432882.786192:0:22760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787432882.786273:0:22760:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1787432882.789256:0:22698:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1787432882.790349:0:22761:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff94843f920a80 x1874258609545728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432882.790364:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00000040:01000000:1.0:1787432882.790805:0:22698:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787432882.790840:0:22698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787432882.791323:0:22698:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787432882.791332:0:22698:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787432882.791370:0:22698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432882.792325:0:22698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787432882.792860:0:22698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787432882.792888:0:22698:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787432882.794958:0:22698:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1787432882.796000:0:22698:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1787432882.798499:0:22698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1787432882.800097:0:22698:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787432882.800720:0:22698:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb0c1c14db988 00100000:10000000:1.0:1787432882.800730:0:22698:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787432882.801662:0:22698:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787432882.801677:0:22698:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.124@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787432882.801694:0:22698:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787432882.801725:0:22698:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787432882.806063:0:22698:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787432882.806364:0:22698:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787432883.341845:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787432883.787936:0:22754:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787432883.787945:0:22754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787432883.793901:0:22754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787432883.793918:0:22754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:1.0:1787432883.851327:0:22716:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787432883.851335:0:22716:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94844112f000 from 11 10000000:01000000:1.0:1787432883.851341:0:22716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787432883.851395:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302691000/0xca72b3b3356405eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432883.851407:0:22716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948302691000/0xca72b3b3356405eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432883.851419:0:22716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948302691000/0xca72b3b3356405eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432883.851447:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609545856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787432883.851516:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432883.851558:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830316b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787432883.851791:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00000100:00100000:3.0:1787432883.851937:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609545856 00000100:00100000:3.0:1787432883.851946:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609545856 00000100:00100000:3.0:1787432883.852015:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787432883.852026:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+11:22716:x1874258609545856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432883.852041:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432883.852059:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94843f85e200/0xca72b3b3356405f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b3356405eb expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432883.852088:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94843f85e200/0xca72b3b3356405f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b3356405eb expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432883.852099:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94843f85e200/0xca72b3b3356405f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356405eb expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432883.852124:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e200, rc 0) 00000100:00100000:3.0:1787432883.852203:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22716:x1874258609545856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432883.852211:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787432883.853825:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609545856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432883.853853:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948302691000/0xca72b3b3356405eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356405f2 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432883.853866:0:22716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948302691000/0xca72b3b3356405eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b3356405f2 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432883.853949:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609545984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787432883.854022:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432883.854065:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432883.854337:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609545984 00000100:00100000:3.0:1787432883.854345:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609545984 00000100:00100000:3.0:1787432883.854385:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787432883.854394:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22716:x1874258609545984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787432883.854415:0:22714:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787432883.854432:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787432883.854435:0:22714:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1787432883.854532:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+12:22716:x1874258609545984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432883.854541:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787432883.856282:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609545984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787432883.856355:0:22716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787432883.856366:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302691000/0xca72b3b3356405eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356405f2 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432883.856388:0:22716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948302691000/0xca72b3b3356405eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356405f2 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432884.365024:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787432884.812014:0:22754:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787432884.812024:0:22754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787432884.812151:0:22754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1787432884.812218:0:22754:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787432884.812385:0:22754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1787432884.875487:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787432885.388387:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432885.900289:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787432886.419030:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432886.924230:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787432887.441424:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432887.510850:0:23003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1787432887.764965:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787432887.764973:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787432887.764976:0:8:0:(import.c:65:import_set_state_nolock()) ffff94843f86d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787432887.764985:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 693 00000100:00080000:1.0:1787432887.764991:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787432887.764998:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94843f86d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432887.765020:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9483039b4a80 x1874258609546240/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787432887.765037:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787432887.765040:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787432887.765049:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787432887.765052:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787432887.765055:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787432887.765058:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787432887.765060:0:8:0:(import.c:65:import_set_state_nolock()) ffff948301d50000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787432887.765066:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff948301d50000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432887.765080:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9483039b6d80 x1874258609546368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432887.766284:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432887.766301:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a13c04c-dd5b-4f06-b031-814868f35d81:3644:1874258609546112:0@lo:400:kworker.0 00000100:00100000:3.0:1787432887.766366:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432887.767342:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609546112 00000100:00100000:3.0:1787432887.767353:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609546112 00000100:00100000:3.0:1787432887.767412:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432887.767422:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+12:3644:x1874258609546112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432887.767495:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+12:3644:x1874258609546112:12345-0@lo:400:kworker.0 Request processed in 73us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432887.767519:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432887.767644:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a13c04c-dd5b-4f06-b031-814868f35d81:3644:1874258609546112:0@lo:400:kworker.0 00000100:00100000:1.0:1787432887.778282:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609546240:0@lo:38:kworker.0 00000100:00100000:1.0:1787432887.778375:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432887.778415:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609546368:0@lo:38:kworker.0 00000100:00100000:1.0:1787432887.778445:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432887.778769:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609546368 00000100:00100000:2.0:1787432887.778778:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609546368 00000100:00100000:2.0:1787432887.778832:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432887.778840:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874258609546368:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787432887.778868:0:22720:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 698 last 0 00000020:00000080:2.0:1787432887.778907:0:22720:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xca72b3b3356405f9 00000004:00100000:2.0:1787432887.778935:0:22720:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787432887.779070:0:22720:0:(import.c:65:import_set_state_nolock()) ffff94842ebc6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432887.779135:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874258609546368:12345-0@lo:38:kworker.0 Request processed in 292us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432887.779142:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787432887.779217:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9483039b6d80 x1874258609546368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787432887.779234:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787432887.779242:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787432887.779248:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787432887.779250:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948301d50000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787432887.779256:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609546368:0@lo:38:kworker.0 00000100:00100000:3.0:1787432887.781137:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609546240 00000100:00100000:3.0:1787432887.781151:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609546240 00000100:00100000:3.0:1787432887.781322:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787432887.781330:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609546240:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787432887.781350:0:22724:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787432887.781418:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609546240:12345-0@lo:38:kworker.0 Request processed in 88us (3044us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787432887.781424:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787432887.781778:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843f86d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432887.781794:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787432887.781798:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609546240:0@lo:38:kworker.0 00000100:00100000:0.0:1787432887.949661:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00000020:00000004:0.0:1787432888.466568:0:23055:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787432888.466735:0:23055:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787432888.469445:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432888.972238:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00000020:00000004:2.0:1787432889.407811:0:23106:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787432889.407995:0:23106:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787432889.485249:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432889.995395:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787432890.507451:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432891.019606:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787432891.534263:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432892.043250:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1787432892.555592:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432892.875876:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432882/real 1787432882] req@ffff948434898380 x1874258609543296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432892 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432892.875915:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948434898380 x1874258609543296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432892 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432892.875928:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432882/real 1787432882] req@ffff9483039b6680 x1874258609543168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432892 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432892.875942:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9483039b6680 x1874258609543168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432892 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787432892.875960:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948304f08000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787432892.875981:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787432892.875985:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609543296:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787432892.876010:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843f868000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787432892.876016:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787432892.876019:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609543168:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787432892.878951:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787432892.878957:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787432892.878961:0:8:0:(import.c:65:import_set_state_nolock()) ffff94843f86d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432892.878968:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 698 00000100:00080000:0.0:1787432892.878973:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787432892.878979:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94843f86d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432892.879001:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948434898380 x1874258609546624/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432892.879019:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432892.879022:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787432892.879024:0:8:0:(import.c:65:import_set_state_nolock()) ffff94843f868000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432892.879027:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 693 00000100:00080000:0.0:1787432892.879029:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787432892.879032:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94843f868000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432892.879041:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94843489bb80 x1874258609546752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432892.879049:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432892.879052:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787432892.879053:0:8:0:(import.c:65:import_set_state_nolock()) ffff948304f08000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432892.879069:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 693 00000100:00080000:0.0:1787432892.879071:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787432892.879075:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948304f08000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432892.879086:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948434899880 x1874258609546880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432892.879129:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609546624:0@lo:38:kworker.0 00000100:00100000:0.0:1787432892.879222:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432892.879280:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609546752:0@lo:8:kworker.0 00000400:00000100:0.0:1787432892.879312:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609546752 offset 0 length 520: 4 00000100:00100000:0.0:1787432892.879330:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609546880:0@lo:8:kworker.0 00000400:00000100:0.0:1787432892.879347:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609546880 offset 0 length 520: 4 00000100:00100000:0.0:1787432892.879380:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609546624 00000100:00100000:0.0:1787432892.879388:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609546624 00000100:00100000:0.0:1787432892.879419:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432892.879427:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609546624:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787432892.879444:0:22724:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787432892.879483:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609546624:12345-0@lo:38:kworker.0 Request processed in 55us (261us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787432892.879490:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787432892.879529:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843f86d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432892.879533:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787432892.879537:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609546624:0@lo:38:kworker.0 00000100:00100000:1.0:1787432892.879726:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432892.879737:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a13c04c-dd5b-4f06-b031-814868f35d81:3643:1874258609546496:0@lo:400:kworker.0 00000100:00100000:1.0:1787432892.879770:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432892.879807:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609547008:0@lo:400:kworker.0 00000100:00100000:1.0:1787432892.879844:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432892.879885:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609547008 00000100:00100000:1.0:1787432892.879889:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609547008 00000100:00100000:1.0:1787432892.879930:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432892.879937:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609547008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432892.879978:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609547008:12345-0@lo:400:kworker.0 Request processed in 41us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432892.879983:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787432892.880011:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff948434898700 x1874258609547008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432892.880022:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609547008:0@lo:400:kworker.0 00000100:00100000:0.0:1787432892.883017:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609546496 00000100:00100000:0.0:1787432892.883032:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609546496 00000100:00100000:0.0:1787432892.883102:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787432892.883125:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+12:3643:x1874258609546496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432892.883245:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+12:3643:x1874258609546496:12345-0@lo:400:kworker.0 Request processed in 122us (3473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432892.883253:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787432892.886391:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a13c04c-dd5b-4f06-b031-814868f35d81:3643:1874258609546496:0@lo:400:kworker.0 00000100:00100000:2.0:1787432893.072427:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787432893.580298:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787432894.028269:0:22754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787432894.091258:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1787432894.607193:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432895.119112:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00000020:01000004:3.0:1787432895.226701:0:23452:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787432895.226706:0:23452:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787432895.226707:0:23452:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787432895.226829:0:23452:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94840557e000 00000020:01000004:3.0:1787432895.226845:0:23452:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1787432895.226857:0:23452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787432895.226871:0:23452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9484093b19b8) 00000020:00000080:3.0:1787432895.226887:0:23452:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787432895.293161:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1787432895.296954:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787432895.298077:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787432895.298507:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787432895.299133:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787432895.299541:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787432895.299801:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1787432895.300071:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787432895.300339:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787432895.300606:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787432895.301017:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787432895.301307:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1787432895.301515:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787432895.302043:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1787432895.305594:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.305856:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787432895.306548:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.307014:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.307419:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.308074:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787432895.308341:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787432895.308537:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.308721:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787432895.309112:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1787432895.309538:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787432895.309755:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.310047:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.311377:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787432895.312207:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.312634:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.313254:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.313560:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.313739:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1787432895.314068:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1787432895.314325:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.314858:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1787432895.317839:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.318552:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.319037:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787432895.319409:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787432895.320430:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1787432895.320779:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.321135:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787432895.321551:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787432895.321792:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787432895.322439:0:23452:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00080000:01000000:2.0:1787432895.323426:0:23452:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787432895.323698:0:23452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787432895.323710:0:23452:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787432895.323727:0:23452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b335640607 00000020:01000004:2.0:1787432895.323735:0:23452:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787432895.323758:0:23452:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.124@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787432895.323771:0:23452:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787432895.323778:0:23452:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787432895.323807:0:23452:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787432895.323812:0:23452:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.124@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787432895.333752:0:23452:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.124@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787432895.333805:0:23452:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.124@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1787432895.333810:0:23452:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787432895.333812:0:23452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787432895.333814:0:23452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432895.333815:0:23452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432895.333816:0:23452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432895.333817:0:23452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432895.333819:0:23452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787432895.333821:0:23452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432895.333822:0:23452:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787432895.333825:0:23452:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1787432895.333827:0:23452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787432895.333828:0:23452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787432895.333829:0:23452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432895.333830:0:23452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432895.333831:0:23452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432895.333832:0:23452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432895.333833:0:23452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787432895.333834:0:23452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432895.333835:0:23452:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787432895.333873:0:23452:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787432895.333894:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609547136:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787432895.333985:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432895.334024:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432895.334191:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609547136 00000100:00100000:2.0:1787432895.334546:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609547136 00000100:00100000:2.0:1787432895.334647:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787432895.334658:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+12:23452:x1874258609547136:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787432895.334691:0:22714:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787432895.334695:0:22714:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1787432895.334701:0:22714:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787432895.336028:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+12:23452:x1874258609547136:12345-0@lo:253:mount.lustre.0 Request processed in 1368us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432895.336039:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787432895.336152:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609547136:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787432895.336180:0:23452:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787432895.336183:0:23452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787432895.336185:0:23452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787432895.336186:0:23452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432895.336187:0:23452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432895.336188:0:23452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432895.336190:0:23452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432895.336191:0:23452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787432895.336193:0:23452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432895.336195:0:23452:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787432895.336214:0:23452:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94840557e000 from lustre-MDT0001 10000000:01000000:3.0:1787432895.336245:0:23452:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1787432895.336248:0:23452:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787432895.336255:0:23452:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94843b95cd28 local copy 00010000:00010000:3.0:1787432895.336265:0:23452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640504 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432895.336358:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609547264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432895.336391:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432895.339878:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff948433799540 going to sleep for 11 seconds 00000100:00100000:0.0:1787432895.340082:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609547264 00000100:00100000:0.0:1787432895.340092:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609547264 00000100:00100000:0.0:1787432895.340149:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787432895.340160:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+12:23452:x1874258609547264:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432895.340488:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+12:23452:x1874258609547264:12345-0@lo:501:mount.lustre.0 Request processed in 320us (4085us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787432895.340498:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787432895.341633:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609547264:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787432895.341663:0:23452:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787432895.341702:0:23452:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787432895.341712:0:23452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640504 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.341723:0:23452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640504 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432895.341782:0:23452:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94840557e000 10000000:01000000:3.0:1787432895.341788:0:23452:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787432895.341792:0:23452:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff94843b95cd28 10000000:01000000:3.0:1787432895.341795:0:23452:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787432895.341798:0:23452:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff94843b95cd28 from 1 10000000:01000000:3.0:1787432895.341801:0:23452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787432895.341832:0:23452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33564060e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.341841:0:23452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33564060e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.341850:0:23452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33564060e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432895.341869:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609547392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432895.341916:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432895.341957:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff948433799540 going to sleep for 11 seconds 00000100:00100000:1.0:1787432895.342100:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609547392 00000100:00100000:1.0:1787432895.342107:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609547392 00000100:00100000:1.0:1787432895.342294:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787432895.342306:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+12:23452:x1874258609547392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432895.342318:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432895.342331:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302690200/0xca72b3b335640615 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33564060e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.342353:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302690200/0xca72b3b335640615 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33564060e expref: 13 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.342364:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302690200/0xca72b3b335640615 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564060e expref: 13 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.342373:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302690200, rc 0) 00000100:00100000:1.0:1787432895.342421:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+13:23452:x1874258609547392:12345-0@lo:101:mount.lustre.0 Request processed in 118us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432895.342435:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787432895.342511:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609547392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432895.342523:0:23452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33564060e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640615 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.342531:0:23452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33564060e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640615 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432895.342546:0:23452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787432895.342565:0:23452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33564060e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640615 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.342586:0:23452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33564060e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640615 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432895.342594:0:23452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff94840557e000 10000000:01000000:3.0:1787432895.342598:0:23452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787432895.342601:0:23452:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff94840557e000 from 1 10000000:01000000:3.0:1787432895.342603:0:23452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787432895.342618:0:23452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85ee00/0xca72b3b33564061c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.342624:0:23452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85ee00/0xca72b3b33564061c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.342631:0:23452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85ee00/0xca72b3b33564061c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432895.342643:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609547520:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432895.342672:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432895.346245:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff948433799540 going to sleep for 11 seconds 00000100:00100000:0.0:1787432895.346357:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609547520 00000100:00100000:0.0:1787432895.346365:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609547520 00000100:00100000:0.0:1787432895.346426:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787432895.346436:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+13:23452:x1874258609547520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432895.346453:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432895.346473:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fc200/0xca72b3b335640623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33564061c expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432895.346512:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fc200/0xca72b3b335640623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33564061c expref: 14 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432895.346522:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fc200/0xca72b3b335640623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564061c expref: 14 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432895.346550:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fc200, rc 0) 00000100:00100000:0.0:1787432895.346627:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+14:23452:x1874258609547520:12345-0@lo:101:mount.lustre.0 Request processed in 182us (3944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432895.346634:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787432895.346793:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609547520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432895.346810:0:23452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85ee00/0xca72b3b33564061c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640623 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.346825:0:23452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85ee00/0xca72b3b33564061c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640623 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432895.346842:0:23452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787432895.346853:0:23452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85ee00/0xca72b3b33564061c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640623 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.346869:0:23452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85ee00/0xca72b3b33564061c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640623 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432895.346878:0:23452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787432895.346882:0:23452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787432895.346888:0:23452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff94840557e000 10000000:01000000:3.0:1787432895.346890:0:23452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787432895.346894:0:23452:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787432895.346896:0:23452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787432895.346918:0:23452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e000/0xca72b3b33564062a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.346926:0:23452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85e000/0xca72b3b33564062a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.346934:0:23452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85e000/0xca72b3b33564062a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432895.346951:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609547648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432895.346986:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432895.347014:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff948433799540 going to sleep for 11 seconds 00000100:00100000:0.0:1787432895.347060:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609547648 00000100:00100000:0.0:1787432895.347065:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609547648 00000100:00100000:0.0:1787432895.347096:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787432895.347103:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+14:23452:x1874258609547648:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432895.347111:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432895.347119:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fdc00/0xca72b3b335640631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33564062a expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432895.347133:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fdc00/0xca72b3b335640631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33564062a expref: 15 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432895.347142:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fdc00/0xca72b3b335640631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564062a expref: 15 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432895.347293:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fdc00, rc 0) 00000100:00100000:0.0:1787432895.347332:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+15:23452:x1874258609547648:12345-0@lo:101:mount.lustre.0 Request processed in 230us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432895.347339:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787432895.347404:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609547648:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432895.347415:0:23452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85e000/0xca72b3b33564062a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640631 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.347422:0:23452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85e000/0xca72b3b33564062a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640631 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787432895.352293:0:23452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1787432895.353583:0:23452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787432895.356974:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787432895.357026:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1787432895.357042:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1787432895.357054:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1787432895.357071:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1787432895.357085:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1787432895.357096:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1787432895.357416:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1787432895.357434:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1787432895.357449:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1787432895.357463:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1787432895.357477:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1787432895.357490:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1787432895.357503:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1787432895.357517:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1787432895.357531:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1787432895.357544:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1787432895.357619:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1787432895.357640:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1787432895.357654:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1787432895.357668:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1787432895.357680:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1787432895.357693:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1787432895.357707:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1787432895.357721:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1787432895.357733:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1787432895.357746:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1787432895.357759:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1787432895.357790:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1787432895.357816:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1787432895.357831:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1787432895.357844:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1787432895.357856:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1787432895.357869:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1787432895.357882:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1787432895.357896:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1787432895.357909:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1787432895.357922:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1787432895.357934:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1787432895.357946:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1787432895.357959:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1787432895.357972:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1787432895.357985:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1787432895.357997:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1787432895.358025:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1787432895.358031:0:23452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1787432895.358135:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609547776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432895.358227:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432895.358341:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484337999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432895.358442:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609547776 00000100:00100000:1.0:1787432895.358449:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609547776 00000100:00100000:1.0:1787432895.358552:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787432895.358561:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+15:23452:x1874258609547776:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432895.358742:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+15:23452:x1874258609547776:12345-0@lo:501:mount.lustre.0 Request processed in 181us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432895.358751:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787432895.358870:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609547776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432895.358903:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609547904:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432895.358940:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432895.359003:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484337999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432895.359036:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609547904 00000100:00100000:0.0:1787432895.359041:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609547904 00000100:00100000:0.0:1787432895.359109:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787432895.359117:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+15:23452:x1874258609547904:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432895.360025:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+15:23452:x1874258609547904:12345-0@lo:503:mount.lustre.0 Request processed in 906us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432895.360040:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787432895.360123:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609547904:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787432895.360569:0:23452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787432895.360637:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609548032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432895.360678:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432895.360918:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff948433799540 going to sleep for 11 seconds 00000100:00100000:1.0:1787432895.360993:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609548032 00000100:00100000:1.0:1787432895.360999:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609548032 00000100:00100000:1.0:1787432895.361028:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787432895.361035:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+15:23452:x1874258609548032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432895.361713:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+15:23452:x1874258609548032:12345-0@lo:502:mount.lustre.0 Request processed in 676us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432895.361722:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787432895.361813:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609548032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787432895.361982:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787432895.362007:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1787432895.362020:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1787432895.362030:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1787432895.362040:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1787432895.362050:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1787432895.362060:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1787432895.362072:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1787432895.362083:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1787432895.362095:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1787432895.362107:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1787432895.362119:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1787432895.362131:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1787432895.362143:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1787432895.362158:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1787432895.362207:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1787432895.362221:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1787432895.362232:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1787432895.362243:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1787432895.362254:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1787432895.362264:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1787432895.362275:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1787432895.362288:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1787432895.362301:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1787432895.362314:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1787432895.362341:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1787432895.362356:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1787432895.362369:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1787432895.362382:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1787432895.362398:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1787432895.362426:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1787432895.362438:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1787432895.362451:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1787432895.362476:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1787432895.362491:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1787432895.362505:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1787432895.362519:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1787432895.362532:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1787432895.362546:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1787432895.362560:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1787432895.362574:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1787432895.362588:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1787432895.362610:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1787432895.362626:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1787432895.362659:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609548160:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432895.362705:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432895.362732:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff948433799540 going to sleep for 11 seconds 00000100:00100000:1.0:1787432895.363028:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609548160 00000100:00100000:1.0:1787432895.363035:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609548160 00000100:00100000:1.0:1787432895.363082:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787432895.363091:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+15:23452:x1874258609548160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432895.363216:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+15:23452:x1874258609548160:12345-0@lo:502:mount.lustre.0 Request processed in 126us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432895.363224:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787432895.363438:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609548160:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787432895.363546:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1787432895.363554:0:23452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787432895.364579:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432895.364593:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432895.364596:0:23456:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787432895.364601:0:23456:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787432895.364611:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432895.364624:0:23456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff94830268b370) 00000020:00000080:1.0:1787432895.364645:0:23456:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787432895.364725:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787432895.364889:0:23456:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787432895.364898:0:23456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b33564063f 00000020:00000080:1.0:1787432895.365108:0:23456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787432895.365113:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432895.365117:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432895.365118:0:23456:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787432895.365121:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432895.365125:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432895.365126:0:23456:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787432895.365129:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432895.365136:0:23456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff948302688000) 00000020:00000080:1.0:1787432895.365148:0:23456:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787432895.365151:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787432895.365153:0:23456:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787432895.365156:0:23456:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787432895.365161:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787432895.365433:0:23456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94840557e000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787432895.365447:0:23456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff94830268cd28) 00000020:00000080:1.0:1787432895.365456:0:23456:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787432895.365589:0:23456:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787432895.365595:0:23456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b335640654 00000020:00000080:1.0:1787432895.365826:0:23456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787432895.365833:0:23456:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787432895.365838:0:23456:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xca72b3b33564065b 00080000:01000000:1.0:1787432895.365844:0:23456:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787432895.365847:0:23456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b335640662 00010000:00010000:2.0:1787432895.429528:0:23456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787432895.430018:0:23456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1787432895.430433:0:23456:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787432895.431526:0:23456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787432895.431539:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432895.431546:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432895.431548:0:23456:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787432895.431552:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432895.431558:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432895.431559:0:23456:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787432895.431562:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787432895.431568:0:23456:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:00000080:3.0:1787432895.431597:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787432895.431613:0:23456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9484093b4d28) 00000020:00000080:3.0:1787432895.431638:0:23456:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1787432895.431645:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787432895.431722:0:23456:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787432895.431729:0:23456:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787432895.431736:0:23456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b335640670 00010000:00080000:3.0:1787432895.431778:0:23456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948416485800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.124@tcp at head 00010000:00010000:3.0:1787432895.433489:0:23456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1787432895.435584:0:23456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787432895.435600:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787432895.435638:0:23456:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787432895.435935:0:23456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b335640677 00000100:00080000:1.0:1787432895.435947:0:23456:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787432895.435954:0:23456:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff948416485800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432895.435989:0:23456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9483039b5500 x1874258609548288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787432895.436014:0:23456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787432895.436043:0:21347:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787432895.436048:0:21347:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787432895.436051:0:21347:0:(import.c:65:import_set_state_nolock()) ffff94843f86d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787432895.436055:0:21347:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 703 00000100:00080000:1.0:1787432895.436059:0:21347:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787432895.436063:0:21347:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94843f86d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432895.436078:0:21347:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9483039b7480 x1874258609548416/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787432895.436089:0:21347:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787432895.436093:0:21347:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787432895.436095:0:21347:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787432895.436098:0:21347:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787432895.436139:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609548544:0@lo:400:kworker.0 00000100:00100000:0.0:1787432895.436204:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609548288:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787432895.436229:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432895.436254:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432895.436290:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609548544 00000100:00100000:0.0:1787432895.436296:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609548416:0@lo:38:kworker.0 00000100:00100000:1.0:1787432895.436298:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609548544 00000100:00100000:0.0:1787432895.436324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432895.436352:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609548288 00000100:00100000:0.0:1787432895.436356:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609548288 00000100:00100000:0.0:1787432895.436375:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609548416 00000100:00100000:0.0:1787432895.436377:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609548416 00000100:00100000:0.0:1787432895.436393:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432895.436402:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609548288:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787432895.436408:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432895.436418:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609548544:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787432895.436429:0:22724:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 706 last 0 00000020:00000080:0.0:1787432895.436464:0:22724:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b33564067e 00000004:00100000:0.0:1787432895.436480:0:22724:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787432895.436485:0:22724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1787432895.436496:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609548544:12345-0@lo:400:kworker.0 Request processed in 79us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432895.436504:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787432895.436547:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9483039b4e00 x1874258609548544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432895.436560:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609548544:0@lo:400:kworker.0 00000020:01000000:0.0:1787432895.436655:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432895.436660:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432895.436662:0:23456:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787432895.436665:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787432895.436668:0:23456:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787432895.436669:0:23456:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787432895.436670:0:23456:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787432895.436672:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787432895.436674:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432895.436676:0:23456:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787432895.436678:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432895.436683:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432895.436684:0:23456:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787432895.436688:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787432895.436738:0:23456:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787432895.436756:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432895.436758:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432895.436770:0:23456:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787432895.436773:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787432895.436775:0:23456:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1787432895.436777:0:23456:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787432895.436778:0:23456:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787432895.436780:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787432895.436783:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432895.436784:0:23456:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787432895.436786:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787432895.436789:0:23456:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787432895.436793:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432895.436794:0:23456:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787432895.436797:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787432895.436801:0:23456:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:01000000:0.0:1787432895.436820:0:23456:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787432895.436822:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787432895.436835:0:23456:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9483030f19b8) 00000020:00000080:0.0:1787432895.436847:0:23456:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787432895.436852:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787432895.436904:0:23456:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1787432895.436910:0:23456:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787432895.436916:0:23456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b33564068c 00010000:00080000:0.0:1787432895.436942:0:23456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948434880800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.124@tcp at head 00010000:00010000:0.0:1787432895.437387:0:23456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1787432895.439014:0:23456:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787432895.439857:0:23456:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1787432895.441420:0:22724:0:(import.c:65:import_set_state_nolock()) ffff94830347a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432895.441740:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1874258609548288:12345-0@lo:38:llog_process_th.0 Request processed in 5335us (5485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432895.441755:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787432895.441793:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787432895.441800:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609548416:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787432895.441840:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609548416:12345-0@lo:38:kworker.0 Request processed in 39us (5515us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787432895.441855:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432895.442504:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787432895.442514:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787432895.442522:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787432895.442528:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787432895.442537:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948416485800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787432895.442651:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609548288:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787432895.442667:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787432895.442672:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843f86d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432895.442675:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787432895.442679:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609548416:0@lo:38:kworker.0 00000100:00100000:1.0:1787432895.442836:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432895.442850:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609548672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432895.442900:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432895.442977:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609548672 00000100:00100000:0.0:1787432895.442983:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609548672 00000100:00100000:0.0:1787432895.443026:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432895.443035:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1874258609548672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432895.443061:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787432895.443106:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1874258609548672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432895.443112:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432895.443144:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609548672:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787432895.443831:0:23456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432895.444275:0:23456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1787432895.444619:0:23456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787432895.445037:0:23461:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787432895.445042:0:23461:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787432895.446918:0:23456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787432895.446932:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787432895.446977:0:23456:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787432895.446999:0:23456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b335640693 00000100:00080000:2.0:1787432895.447009:0:23456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787432895.447015:0:23456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff948434880800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432895.447051:0:23456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94843f921880 x1874258609548800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432895.447112:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609548800:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787432895.447218:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609548800 offset 0 length 520: 4 00000100:00080000:2.0:1787432895.447364:0:23456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787432895.447426:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432895.447431:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432895.447433:0:23456:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787432895.447436:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787432895.447439:0:23456:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1787432895.447440:0:23456:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787432895.447442:0:23456:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787432895.447443:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787432895.447445:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432895.447447:0:23456:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787432895.447449:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787432895.447463:0:23456:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787432895.447468:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432895.447469:0:23456:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787432895.447473:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787432895.447476:0:23456:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:01000000:2.0:1787432895.447498:0:23456:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787432895.447506:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787432895.447518:0:23456:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff94843b95b370) 00000020:00000080:2.0:1787432895.447531:0:23456:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1787432895.447536:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787432895.447595:0:23456:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787432895.447601:0:23456:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787432895.447607:0:23456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b3356406a1 00010000:00080000:2.0:1787432895.447644:0:23456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94843c7f0000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.124@tcp at head 00010000:00010000:2.0:1787432895.447862:0:23456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1787432895.447929:0:23456:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787432895.447944:0:23456:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1787432895.448134:0:21347:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787432895.448140:0:21347:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787432895.448143:0:21347:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787432895.448146:0:21347:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787432895.449655:0:23456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432895.449861:0:23456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1787432895.449977:0:23456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1787432895.450536:0:23463:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787432895.450541:0:23463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787432895.451230:0:23456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787432895.451242:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787432895.451281:0:23456:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787432895.451306:0:23456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b3356406a8 00000100:00080000:2.0:1787432895.451316:0:23456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787432895.451323:0:23456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94843c7f0000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432895.451357:0:23456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94843f920700 x1874258609548928/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432895.451382:0:23456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787432895.451421:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609548928:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1787432895.451443:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432895.451447:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432895.451449:0:23456:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787432895.451452:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432895.451456:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432895.451457:0:23456:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787432895.451460:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787432895.451462:0:23456:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787432895.451472:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432895.451474:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432895.451475:0:23456:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787432895.451477:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432895.451479:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432895.451480:0:23456:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787432895.451483:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000400:00000100:0.0:1787432895.451495:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609548928 offset 0 length 520: 4 00000020:01000000:2.0:1787432895.451505:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432895.451507:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432895.451508:0:23456:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787432895.451511:0:23456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:1.0:1787432895.451664:0:21347:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787432895.451669:0:21347:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787432895.451673:0:21347:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787432895.451675:0:21347:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1787432895.451849:0:23452:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1787432895.451879:0:23452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787432895.451937:0:23452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e000/0xca72b3b33564062a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640631 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.451948:0:23452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85e000/0xca72b3b33564062a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640631 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432895.451956:0:23452:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94840557e000 from 1 10000000:01000000:3.0:1787432895.451958:0:23452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787432895.451984:0:23452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b3356406af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.451992:0:23452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b3356406af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.452002:0:23452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b3356406af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432895.452018:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549056:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432895.452057:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432895.452088:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff948433799c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432895.452103:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609549056 00000100:00100000:2.0:1787432895.452109:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609549056 00000100:00100000:2.0:1787432895.452155:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787432895.452187:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+15:23452:x1874258609549056:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432895.452201:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432895.452214:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948301f04600/0xca72b3b3356406b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b3356406af expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432895.452240:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948301f04600/0xca72b3b3356406b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b3356406af expref: 16 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432895.452250:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948301f04600/0xca72b3b3356406b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356406af expref: 16 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432895.452260:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f04600, rc 0) 00000100:00100000:2.0:1787432895.452312:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+16:23452:x1874258609549056:12345-0@lo:101:mount.lustre.0 Request processed in 147us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432895.452319:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787432895.452352:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549056:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432895.452366:0:23452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b3356406af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356406b6 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.452375:0:23452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b3356406af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b3356406b6 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432895.452976:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549184:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787432895.453007:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432895.453034:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff948433799c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432895.453048:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609549184 00000100:00100000:2.0:1787432895.453053:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609549184 00000100:00100000:2.0:1787432895.453151:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787432895.453158:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+16:23452:x1874258609549184:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787432895.453207:0:22714:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787432895.453222:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787432895.453225:0:22714:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787432895.453311:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+16:23452:x1874258609549184:12345-0@lo:256:mount.lustre.0 Request processed in 153us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432895.453318:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549184:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787432895.453318:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 10000000:01000000:3.0:1787432895.454027:0:23452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787432895.454050:0:23452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b3356406af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356406b6 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.454060:0:23452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b3356406af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356406b6 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432895.454069:0:23452:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94840557e000 from 1 10000000:01000000:3.0:1787432895.454076:0:23452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432895.454110:0:23452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b3356406bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.454118:0:23452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b3356406bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.454131:0:23452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b3356406bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432895.454221:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549312:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432895.454261:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432895.454288:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff948433799c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432895.454299:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609549312 00000100:00100000:2.0:1787432895.454304:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609549312 00000100:00100000:3.0:1787432895.454401:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787432895.454410:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+16:23452:x1874258609549312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432895.454420:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432895.454431:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94843f85f600/0xca72b3b3356406c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b3356406bd expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.454450:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94843f85f600/0xca72b3b3356406c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b3356406bd expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.454459:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94843f85f600/0xca72b3b3356406c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356406bd expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.454468:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85f600, rc 0) 00000100:00100000:3.0:1787432895.454507:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+17:23452:x1874258609549312:12345-0@lo:101:mount.lustre.0 Request processed in 98us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432895.454513:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787432895.454556:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432895.454570:0:23452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b3356406bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356406c4 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.454578:0:23452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b3356406bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b3356406c4 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432895.455680:0:23452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1787432895.455931:0:23452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432895.456111:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787432895.456137:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1787432895.456255:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1787432895.456284:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1787432895.456299:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1787432895.456313:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1787432895.456325:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1787432895.456337:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1787432895.456349:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787432895.456361:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1787432895.456373:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1787432895.456391:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1787432895.456396:0:23452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1787432895.456531:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432895.456589:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432895.456660:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609549440 00000100:00100000:0.0:1787432895.456667:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609549440 00000100:00100000:0.0:1787432895.456718:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787432895.456728:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+17:23452:x1874258609549440:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432895.456752:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840133a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432895.456840:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+17:23452:x1874258609549440:12345-0@lo:501:mount.lustre.0 Request processed in 114us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432895.456849:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787432895.456910:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432895.456938:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787432895.456968:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432895.457015:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840133a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432895.457044:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609549568 00000100:00100000:3.0:1787432895.457047:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609549568 00000100:00100000:3.0:1787432895.457066:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787432895.457070:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+17:23452:x1874258609549568:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432895.457178:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+17:23452:x1874258609549568:12345-0@lo:503:mount.lustre.0 Request processed in 90us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432895.457186:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787432895.457245:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549568:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787432895.457618:0:23452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787432895.457667:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432895.457700:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432895.457728:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034cd600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432895.457789:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609549696 00000100:00100000:0.0:1787432895.457793:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609549696 00000100:00100000:0.0:1787432895.457875:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787432895.457882:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+17:23452:x1874258609549696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432895.457966:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+17:23452:x1874258609549696:12345-0@lo:502:mount.lustre.0 Request processed in 85us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432895.457973:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787432895.458049:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432895.458289:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787432895.458314:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1787432895.458329:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1787432895.458343:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1787432895.458372:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1787432895.458388:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1787432895.458401:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1787432895.458414:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1787432895.458427:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787432895.458438:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1787432895.458449:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1787432895.458545:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432895.458583:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432895.458649:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034cd600 going to sleep for 11 seconds 00000100:00100000:3.0:1787432895.458684:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609549824 00000100:00100000:3.0:1787432895.458689:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609549824 00000100:00100000:3.0:1787432895.458775:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787432895.458783:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b141c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+17:23452:x1874258609549824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432895.458869:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b141c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+17:23452:x1874258609549824:12345-0@lo:502:mount.lustre.0 Request processed in 87us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432895.458877:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787432895.458940:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432895.458977:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1787432895.458985:0:23452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787432895.459908:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432895.459919:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432895.459921:0:23465:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787432895.459929:0:23465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94840557e000 00000020:00000080:0.0:1787432895.459932:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432895.459940:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432895.459942:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432895.459944:0:23465:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787432895.459946:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432895.459949:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432895.459950:0:23465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787432895.459954:0:23465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94840557e000 00000020:00000080:0.0:1787432895.459956:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432895.460036:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432895.460039:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432895.460040:0:23465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787432895.460043:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432895.460045:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432895.460046:0:23465:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787432895.460049:0:23465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94840557e000 00000020:00000080:0.0:1787432895.460056:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432895.460545:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432895.460550:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432895.460551:0:23465:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787432895.460554:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432895.460557:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432895.460559:0:23465:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787432895.460563:0:23465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94840557e000 00000020:00000080:0.0:1787432895.460565:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432895.460593:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432895.460596:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432895.460597:0:23465:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787432895.460600:0:23465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1787432895.462226:0:23452:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787432895.462274:0:23452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432895.462311:0:23452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b3356406bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356406c4 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432895.462324:0:23452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b3356406bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356406c4 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432895.462592:0:23452:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787432895.462595:0:23452:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94840557e000 10000000:01000000:2.0:1787432895.462599:0:23452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94840557e000 10000000:01000000:2.0:1787432895.462604:0:23452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787432895.462611:0:23452:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94840557e000 from 1 10000000:01000000:2.0:1787432895.462614:0:23452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787432895.462649:0:23452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f04a00/0xca72b3b3356406cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432895.462658:0:23452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948301f04a00/0xca72b3b3356406cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432895.462669:0:23452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948301f04a00/0xca72b3b3356406cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432895.462692:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787432895.462839:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432895.462959:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034cd000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432895.463187:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609549952 00000100:00100000:1.0:1787432895.463195:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609549952 00000100:00100000:1.0:1787432895.463240:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787432895.463250:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b141850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+17:23452:x1874258609549952:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432895.463265:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432895.463279:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302690600/0xca72b3b3356406d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b3356406cb expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.463303:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302690600/0xca72b3b3356406d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b3356406cb expref: 18 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.463313:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302690600/0xca72b3b3356406d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356406cb expref: 18 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.463321:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302690600, rc 0) 00000100:00100000:1.0:1787432895.463360:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b141850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+18:23452:x1874258609549952:12345-0@lo:101:mount.lustre.0 Request processed in 111us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432895.463367:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787432895.463431:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609549952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432895.463447:0:23452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948301f04a00/0xca72b3b3356406cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356406d2 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432895.463456:0:23452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948301f04a00/0xca72b3b3356406cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b3356406d2 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432895.465645:0:23452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1787432895.466393:0:23452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432895.467434:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1787432895.467981:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1787432895.467999:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1787432895.468012:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1787432895.468024:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1787432895.468037:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1787432895.468050:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1787432895.468078:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1787432895.468092:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1787432895.468104:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1787432895.468116:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1787432895.468129:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1787432895.471497:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1787432895.471638:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1787432895.471660:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1787432895.471675:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1787432895.471688:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1787432895.471701:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1787432895.471713:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1787432895.471727:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1787432895.471741:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1787432895.471755:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1787432895.471783:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1787432895.471820:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1787432895.471837:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1787432895.471850:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1787432895.471862:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1787432895.471873:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1787432895.471884:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1787432895.471907:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1787432895.471919:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1787432895.471931:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1787432895.471943:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1787432895.471955:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1787432895.471967:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1787432895.471979:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1787432895.471990:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1787432895.472001:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1787432895.472012:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1787432895.472034:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1787432895.472046:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1787432895.472057:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1787432895.472069:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1787432895.472082:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1787432895.472094:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1787432895.472113:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1787432895.472129:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1787432895.472143:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1787432895.472338:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1787432895.472358:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1787432895.472374:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1787432895.472379:0:23452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1787432895.472485:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609550080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432895.472572:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432895.472605:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609550080 00000100:00100000:3.0:1787432895.472612:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609550080 00000100:00100000:2.0:1787432895.472616:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034cd900 going to sleep for 11 seconds 00000100:00100000:3.0:1787432895.472672:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787432895.472683:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b142850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+18:23452:x1874258609550080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432895.472808:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b142850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+18:23452:x1874258609550080:12345-0@lo:501:mount.lustre.0 Request processed in 127us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432895.472816:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787432895.473358:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609550080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432895.473389:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609550208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787432895.473425:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432895.473444:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034cd900 going to sleep for 11 seconds 00000100:00100000:1.0:1787432895.473742:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609550208 00000100:00100000:1.0:1787432895.473747:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609550208 00000100:00100000:1.0:1787432895.473828:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787432895.473837:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b142450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+18:23452:x1874258609550208:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432895.473926:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b142450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+18:23452:x1874258609550208:12345-0@lo:503:mount.lustre.0 Request processed in 89us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432895.473933:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787432895.473989:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609550208:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787432895.475304:0:23452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787432895.475379:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609550336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432895.475431:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432895.475542:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609550336 00000100:00100000:2.0:1787432895.475547:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609550336 00000100:00100000:2.0:1787432895.475595:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787432895.475604:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b140450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+18:23452:x1874258609550336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432895.476065:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b140450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+18:23452:x1874258609550336:12345-0@lo:502:mount.lustre.0 Request processed in 461us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432895.476074:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787432895.476123:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034cd000 going to sleep for 11 seconds 00000100:00100000:2.0:1787432895.476271:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609550336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432895.476538:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1787432895.476689:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1787432895.476706:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1787432895.476718:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1787432895.476730:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1787432895.476743:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1787432895.476756:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1787432895.476874:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1787432895.476887:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1787432895.476899:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1787432895.476911:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1787432895.476924:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1787432895.476936:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1787432895.476949:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1787432895.476961:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1787432895.476982:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1787432895.476995:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1787432895.477022:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1787432895.477036:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1787432895.477046:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1787432895.477058:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1787432895.477070:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1787432895.477081:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1787432895.477093:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1787432895.477105:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1787432895.477116:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1787432895.477127:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1787432895.477138:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1787432895.480844:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1787432895.480862:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1787432895.480875:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1787432895.480887:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1787432895.480901:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1787432895.480932:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1787432895.480947:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1787432895.480959:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1787432895.480972:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1787432895.480983:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1787432895.480997:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1787432895.481009:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1787432895.481022:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1787432895.481034:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1787432895.481048:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1787432895.481061:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1787432895.481073:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1787432895.481086:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1787432895.481099:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1787432895.481110:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1787432895.481242:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609550464:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432895.481319:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432895.481360:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034cd000 going to sleep for 11 seconds 00000100:00100000:0.0:1787432895.481909:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609550464 00000100:00100000:0.0:1787432895.481917:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609550464 00000100:00100000:0.0:1787432895.481974:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787432895.481985:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b143c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+18:23452:x1874258609550464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432895.482111:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b143c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+18:23452:x1874258609550464:12345-0@lo:502:mount.lustre.0 Request processed in 127us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432895.482119:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787432895.482259:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609550464:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432895.482438:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1787432895.482707:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1787432895.482735:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609550592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432895.482956:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432895.482990:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034cd000 going to sleep for 11 seconds 00000100:00100000:3.0:1787432895.483621:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609550592 00000100:00100000:3.0:1787432895.483627:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609550592 00000100:00100000:3.0:1787432895.483741:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787432895.483750:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b141450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+18:23452:x1874258609550592:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432895.483878:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b141450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+18:23452:x1874258609550592:12345-0@lo:502:mount.lustre.0 Request processed in 128us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432895.483885:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787432895.483927:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609550592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432895.483988:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1787432895.483998:0:23452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787432895.487246:0:23471:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787432895.487267:0:23471:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9484349d19b8) 00000020:00000080:3.0:1787432895.487292:0:23471:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787432895.487372:0:23471:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94840557e000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787432895.487376:0:23471:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94840557e000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787432895.487379:0:23471:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94840557e000 3 00010000:00080000:3.0:1787432895.487414:0:23471:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948427f83800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.124@tcp at head 00010000:00010000:3.0:1787432895.489066:0:23471:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787432895.489414:0:23471:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787432895.489448:0:23471:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787432895.489458:0:23471:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xca72b3b3356406e0 00000100:00080000:3.0:1787432895.489468:0:23471:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787432895.489473:0:23471:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff948427f83800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432895.489507:0:23471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948403568a80 x1874258609550720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432895.489535:0:23471:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787432895.489902:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874258609550720:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787432895.490520:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432895.491295:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609550720 00000100:00100000:0.0:1787432895.491306:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609550720 00000100:00100000:0.0:1787432895.491348:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432895.491356:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874258609550720:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787432895.491382:0:22720:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 706 last 0 00000020:00000080:0.0:1787432895.491422:0:22720:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xca72b3b3356406e7 00000004:00100000:0.0:1787432895.491436:0:22720:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787432895.491474:0:22720:0:(import.c:65:import_set_state_nolock()) ffff948434885800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432895.491540:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874258609550720:12345-0@lo:38:llog_process_th.0 Request processed in 183us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432895.491748:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787432895.491813:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff948403568a80 x1874258609550720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432895.491825:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787432895.491834:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787432895.491841:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787432895.491845:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787432895.491847:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948427f83800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787432895.491853:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874258609550720:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787432895.491990:0:21347:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432895.491995:0:21347:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432895.491998:0:21347:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432895.492001:0:21347:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1787432895.492733:0:23471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1787432895.493193:0:23452:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787432895.493231:0:23452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787432895.493249:0:23452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f04a00/0xca72b3b3356406cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356406d2 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432895.493261:0:23452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948301f04a00/0xca72b3b3356406cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356406d2 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787432895.493321:0:23452:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787432895.494156:0:23452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787432895.494161:0:23452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432895.494195:0:23452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432895.494196:0:23452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432895.494198:0:23452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432895.494200:0:23452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432895.494201:0:23452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432895.494203:0:23452:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787432895.494207:0:23452:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1787432895.494209:0:23452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787432895.494210:0:23452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787432895.494211:0:23452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432895.494212:0:23452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432895.494213:0:23452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432895.494214:0:23452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432895.494215:0:23452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432895.494216:0:23452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432895.494217:0:23452:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787432895.494276:0:23452:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787432895.494296:0:23452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609550848:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787432895.494362:0:23452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432895.494397:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609550848 00000100:00100000:0.0:1787432895.494405:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609550848 00000100:00100000:2.0:1787432895.494406:0:23452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034cd600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432895.494465:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787432895.494476:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b140050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+18:23452:x1874258609550848:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787432895.494501:0:22711:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787432895.494514:0:22711:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1787432895.500078:0:22699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787432895.500118:0:22711:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787432895.500128:0:22711:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787432895.500969:0:22734:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787432895.500976:0:22734:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787432895.501752:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9484013fd400/0xca72b3b3356406ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432895.502351:0:22734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94843f85e200/0xca72b3b3356405f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356405eb expref: 18 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432895.502370:0:22734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948301f04600/0xca72b3b3356406b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356406af expref: 18 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432895.502378:0:22734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9484013fd400/0xca72b3b3356406ee lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432895.502419:0:22734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948301f04600/0xca72b3b3356406b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b3356406af expref: 18 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432895.502433:0:22734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948301f04600/0xca72b3b3356406b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b3356406af expref: 18 pid: 22711 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432895.502449:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434899c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22734:1874258609550976:0@lo:104: 00000100:00100000:0.0:1787432895.502523:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432895.502588:0:22734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94843f85e200/0xca72b3b3356405f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b3356405eb expref: 18 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432895.502596:0:22734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94843f85e200/0xca72b3b3356405f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b3356405eb expref: 18 pid: 22711 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432895.502605:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22734:1874258609551104:0@lo:104: 00000100:00100000:1.0:1787432895.502615:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609550976 00000100:00100000:1.0:1787432895.502625:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609550976 00000100:00100000:0.0:1787432895.502626:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432895.502687:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609551104 00000100:00100000:3.0:1787432895.502692:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609551104 00000100:00100000:3.0:1787432895.502728:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787432895.502737:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434898000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+3:22734:x1874258609551104:12345-0@lo:104: 00010000:00010000:3.0:1787432895.502749:0:22703:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948302691000/0xca72b3b3356405eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356405f2 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.505651:0:22703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787432895.505670:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434898000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+4:22734:x1874258609551104:12345-0@lo:104: Request processed in 2929us (3038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432895.505683:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787432895.505727:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432895.505740:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+3:22734:x1874258609550976:12345-0@lo:104: 00010000:00010000:3.0:1787432895.505768:0:22703:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b3356406af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356406b6 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.505876:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432895.505884:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948302691000/0xca72b3b3356405eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356405f2 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.505893:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302691000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432895.505897:0:22707:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948302691000/0xca72b3b3356405eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b3356405f2 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.505906:0:22707:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948302691000/0xca72b3b3356405eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b3356405f2 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432895.505914:0:22707:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948302691000/0xca72b3b3356405eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b3356405f2 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432895.505920:0:22707:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432895.506006:0:22707:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948302691000/0xca72b3b3356405eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356405f2 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.506013:0:22707:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432895.506036:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948302691000/0xca72b3b3356405eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356405f2 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.506043:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948302691000/0xca72b3b3356405eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356405f2 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.506057:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432895.506060:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b3356406af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356406b6 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.506066:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fe00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432895.506069:0:22707:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b3356406af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b3356406b6 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.506086:0:22707:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b3356406af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b3356406b6 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432895.506092:0:22707:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b3356406af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b3356406b6 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432895.506098:0:22707:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787432895.506333:0:22703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787432895.506341:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+3:22734:x1874258609550976:12345-0@lo:104: Request processed in 606us (3817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432895.506356:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787432895.508885:0:22707:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b3356406af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356406b6 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.508899:0:22707:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432895.508921:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b3356406af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356406b6 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.508929:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b3356406af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356406b6 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.508951:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432895.508953:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432895.508955:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432895.508965:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432895.508982:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a13c04c-dd5b-4f06-b031-814868f35d81:3641:1874258609551360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432895.509050:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432895.509115:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609551360 00000100:00100000:1.0:1787432895.509122:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609551360 00010000:00010000:1.0:1787432895.509236:0:22704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948301f04600/0xca72b3b3356406b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356406af expref: 19 pid: 22711 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432895.509268:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432895.509291:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a13c04c-dd5b-4f06-b031-814868f35d81+19:3641:x1874258609551360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432895.509305:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432895.509311:0:22704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948301f04600/0xca72b3b3356406b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356406af expref: 19 pid: 22711 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.509322:0:22704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948301f04600/0xca72b3b3356406b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b3356406af expref: 19 pid: 22711 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432895.509339:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432895.509372:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a13c04c-dd5b-4f06-b031-814868f35d81+19:3641:x1874258609551360:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432895.509378:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432895.509417:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a13c04c-dd5b-4f06-b031-814868f35d81:3641:1874258609551360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432895.510320:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a13c04c-dd5b-4f06-b031-814868f35d81:3644:1874258609551232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432895.510362:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432895.510461:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b140050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+18:23452:x1874258609550848:12345-0@lo:253:mount.lustre.0 Request processed in 15987us (16098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432895.510471:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787432895.510568:0:23452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:23452:1874258609550848:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787432895.510581:0:23452:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787432895.510584:0:23452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787432895.510586:0:23452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787432895.510587:0:23452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432895.510589:0:23452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432895.510590:0:23452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432895.510592:0:23452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432895.510593:0:23452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432895.510595:0:23452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432895.510597:0:23452:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787432895.510608:0:23452:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787432895.512647:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787432895.512684:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948301f04600/0xca72b3b3356406b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b3356406af expref: 17 pid: 22711 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432895.512700:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434899c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22734:1874258609550976:0@lo:104: 00000100:00100000:0.0:1787432895.512710:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22734:1874258609551104:0@lo:104: 00010000:00010000:0.0:1787432895.512744:0:22734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9484013fd400/0xca72b3b3356406ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432895.512808:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609551232 00000100:00100000:3.0:1787432895.512816:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609551232 00010000:00010000:3.0:1787432895.512849:0:22706:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94843f85e200/0xca72b3b3356405f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356405eb expref: 17 pid: 22711 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432895.512887:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432895.512897:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a13c04c-dd5b-4f06-b031-814868f35d81+17:3644:x1874258609551232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432895.512910:0:22706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432895.512915:0:22706:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94843f85e200/0xca72b3b3356405f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356405eb expref: 17 pid: 22711 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.512926:0:22706:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94843f85e200/0xca72b3b3356405f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b3356405eb expref: 17 pid: 22711 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.512942:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94843f85e200/0xca72b3b3356405f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b3356405eb expref: 17 pid: 22711 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.512955:0:22706:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9484013fd400/0xca72b3b3356406ee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.512963:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fd400/0xca72b3b3356406ee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787432895.512977:0:22706:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012002050s 00010000:00010000:3.0:1787432895.512982:0:22706:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484013fd400/0xca72b3b3356406ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.512988:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484013fd400/0xca72b3b3356406ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.513005:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9484013fd400/0xca72b3b3356406ee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.513012:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9484013fd400/0xca72b3b3356406ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.513018:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fd400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432895.513022:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9484013fd400/0xca72b3b3356406ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.513036:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9484013fd400/0xca72b3b3356406ee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.513054:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9484013fd400/0xca72b3b3356406ee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432895.513063:0:22706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432895.513121:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a13c04c-dd5b-4f06-b031-814868f35d81+16:3644:x1874258609551232:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (2758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432895.513130:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787432895.513233:0:22734:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9484013fd400/0xca72b3b3356406ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432895.513251:0:22734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9484013fd400/0xca72b3b3356406ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432895.513258:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fd400/0xca72b3b3356406ee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432895.513385:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a13c04c-dd5b-4f06-b031-814868f35d81:3644:1874258609551232:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1787432895.516443:0:23452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1787432895.516515:0:23476:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787432895.516519:0:23476:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787432895.516836:0:23477:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787432895.517291:0:23477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1787432895.520019:0:23452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1787432895.522232:0:23478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23478:1874258609551488:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787432895.522307:0:23478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432895.522352:0:23478:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432895.522381:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609551488 00000100:00100000:1.0:1787432895.522390:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609551488 00000100:00100000:1.0:1787432895.522450:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432895.522460:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23478:x1874258609551488:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787432895.522563:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23478:x1874258609551488:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 102us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432895.522572:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:3.0:1787432895.522731:0:23452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1787432895.522920:0:23478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23478:1874258609551488:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1787432895.522947:0:23478:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787432895.522973:0:23478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23478:1874258609551616:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787432895.523010:0:23478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432895.523036:0:23478:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432895.523063:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609551616 00000100:00100000:1.0:1787432895.523068:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609551616 00000100:00100000:1.0:1787432895.523100:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000040:00080000:3.0:1787432895.523106:0:23452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787432895.523110:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23478:x1874258609551616:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787432895.523240:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23478:x1874258609551616:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 133us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432895.523247:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00000080:3.0:1787432895.523572:0:23452:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787432895.523581:0:23452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787432895.523622:0:23452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787432895.524573:0:23452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787432895.525130:0:23452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787432895.525192:0:23452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1787432895.525292:0:23452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432895.526035:0:23477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787432895.526089:0:23477:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1787432895.526244:0:23478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23478:1874258609551616:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787432895.526321:0:23478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23478:1874258609551744:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787432895.526376:0:23478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432895.526420:0:23478:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432895.526607:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609551744 00000100:00100000:1.0:1787432895.526615:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609551744 00000100:00100000:1.0:1787432895.526717:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432895.526727:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23478:x1874258609551744:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787432895.526796:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23478:x1874258609551744:12345-0@lo:900:lod0001_rec0000.0 Request processed in 70us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432895.526805:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787432895.526817:0:23478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff948434899180 x1874258609551744/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787432911 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432895.526839:0:23478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23478:1874258609551744:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787432895.526886:0:23478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23478:1874258609551872:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787432895.526915:0:23478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432895.526938:0:23478:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550b3c0 going to sleep for 11 seconds 00080000:10000000:3.0:1787432895.527417:0:23452:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:1.0:1787432895.527708:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609551872 00000100:00100000:1.0:1787432895.527714:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609551872 00000100:00100000:1.0:1787432895.527755:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432895.527772:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23478:x1874258609551872:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787432895.527862:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23478:x1874258609551872:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 91us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432895.527869:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787432895.527954:0:23478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23478:1874258609551872:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787432895.527997:0:23478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432895.530116:0:23478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787432895.530215:0:23478:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787432895.530221:0:23478:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1787432895.533091:0:23452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1787432895.537031:0:23452:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787432895.537074:0:23452:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb0c1c14db988 00100000:10000000:3.0:1787432895.537082:0:23452:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1787432895.537725:0:23452:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787432895.537751:0:23452:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.124@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787432895.537782:0:23452:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787432895.537797:0:23452:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787432895.544190:0:23452:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787432895.544502:0:23452:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787432895.630872:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432896.140227:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00000040:00080000:1.0:1787432896.523838:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787432896.651376:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787432896.652246:0:22716:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787432896.652252:0:22716:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94840557e000 from 12 10000000:01000000:3.0:1787432896.652256:0:22716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787432896.652303:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e200/0xca72b3b3356406f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432896.652316:0:22716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85e200/0xca72b3b3356406f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432896.652328:0:22716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85e200/0xca72b3b3356406f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432896.652355:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609552000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432896.652424:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432896.652902:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb11600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432896.654144:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609552000 00000100:00100000:0.0:1787432896.654156:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609552000 00000100:00100000:0.0:1787432896.654268:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787432896.654278:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b143850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+16:22716:x1874258609552000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432896.654295:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432896.654313:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fd600/0xca72b3b3356406fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b3356406f5 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432896.654340:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fd600/0xca72b3b3356406fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b3356406f5 expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432896.654351:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fd600/0xca72b3b3356406fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356406f5 expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432896.654360:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fd600, rc 0) 00000100:00100000:0.0:1787432896.654483:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b143850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+17:22716:x1874258609552000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (2058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432896.654491:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787432896.654801:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609552000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432896.654824:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85e200/0xca72b3b3356406f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356406fc expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432896.654835:0:22716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85e200/0xca72b3b3356406f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b3356406fc expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432896.654917:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609552128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787432896.654956:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432896.654995:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb11600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432896.655232:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609552128 00000100:00100000:0.0:1787432896.655238:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609552128 00000100:00100000:0.0:1787432896.655276:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787432896.655284:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+17:22716:x1874258609552128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787432896.655307:0:22711:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787432896.655323:0:22711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787432896.655327:0:22711:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1787432896.655411:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+17:22716:x1874258609552128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432896.655418:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787432896.655496:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609552128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787432896.655542:0:22716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787432896.655551:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e200/0xca72b3b3356406f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356406fc expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432896.655560:0:22716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85e200/0xca72b3b3356406f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356406fc expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432896.655570:0:22716:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787432896.655572:0:22716:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94844112f000 from 12 10000000:01000000:3.0:1787432896.655575:0:22716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787432896.655596:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b335640703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432896.655605:0:22716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b335640703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432896.655613:0:22716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b335640703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432896.655627:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609552256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432896.655653:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432896.655715:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb11600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432896.658444:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609552256 00000100:00100000:0.0:1787432896.658457:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609552256 00000100:00100000:0.0:1787432896.658516:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787432896.658528:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b141050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+17:22716:x1874258609552256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432896.658545:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432896.658562:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fde00/0xca72b3b33564070a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b335640703 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432896.658592:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fde00/0xca72b3b33564070a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b335640703 expref: 18 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432896.658604:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fde00/0xca72b3b33564070a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b335640703 expref: 18 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432896.658613:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fde00, rc 0) 00000100:00100000:0.0:1787432896.658766:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b141050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+18:22716:x1874258609552256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (3110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432896.658775:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787432896.662149:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609552256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432896.662209:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b335640703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33564070a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432896.662221:0:22716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b335640703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33564070a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432896.662298:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609552384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787432896.662371:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432896.662408:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609552384 00000100:00100000:3.0:1787432896.662410:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb11600 going to sleep for 11 seconds 00000100:00100000:2.0:1787432896.662419:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609552384 00000100:00100000:2.0:1787432896.662550:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787432896.662562:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b142c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+18:22716:x1874258609552384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787432896.662583:0:22712:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787432896.662601:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787432896.662605:0:22712:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1787432896.662802:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b142c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+18:22716:x1874258609552384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432896.662810:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787432896.663570:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609552384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787432896.663627:0:22716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787432896.663637:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b335640703 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33564070a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432896.663646:0:22716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b335640703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33564070a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432897.164032:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00000040:00080000:1.0:1787432897.548494:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787432897.676802:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432898.187234:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787432898.705623:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432899.212227:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00000001:02000400:2.0:1787432899.324235:0:23721:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787432899.723465:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787432900.134627:0:23773:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432900.134850:0:23773:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787432900.236315:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 0 seconds 00000100:00080000:2.0:1787432900.555451:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787432900.555458:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787432900.555462:0:8:0:(import.c:65:import_set_state_nolock()) ffff94843f86d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432900.555475:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94843f86d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432900.555497:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94843f921180 x1874258609552640/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432900.555521:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432900.555534:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432900.555537:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432900.555540:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432900.555566:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432900.555569:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432900.555572:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432900.555574:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787432900.555605:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a13c04c-dd5b-4f06-b031-814868f35d81:3642:1874258609552512:0@lo:400:kworker.0 00000100:00100000:2.0:1787432900.555684:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432900.555735:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432900.555741:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609553024:0@lo:400:kworker.0 00000100:00100000:2.0:1787432900.555770:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432900.555803:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609552768:0@lo:400:kworker.0 00000100:00100000:2.0:1787432900.555824:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432900.555841:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432900.555845:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609552896:0@lo:400:kworker.0 00000100:00100000:2.0:1787432900.555868:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432900.555901:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609552512 00000100:00100000:2.0:1787432900.555908:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609552512 00000100:00100000:0.0:1787432900.555967:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609552640:0@lo:38:kworker.0 00000100:00100000:0.0:1787432900.556000:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432900.556043:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609552896 00000100:00100000:0.0:1787432900.556048:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609552896 00000100:00100000:0.0:1787432900.556078:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609552640 00000100:00100000:0.0:1787432900.556081:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609552640 00000100:00100000:0.0:1787432900.556093:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432900.556102:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609552896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432900.556921:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609552896:12345-0@lo:400:kworker.0 Request processed in 817us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432900.556931:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432900.556951:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787432900.556957:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609552640:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787432900.556980:0:22724:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 711 last 0 00000020:00000080:0.0:1787432900.557017:0:22724:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b335640711 00000004:00100000:0.0:1787432900.557034:0:22724:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787432900.557039:0:22724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1787432900.557475:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432900.557487:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609553152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432900.557521:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432900.558595:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609552896:0@lo:400:kworker.0 00000100:00100000:2.0:1787432900.558743:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787432900.558758:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b140c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+18:3642:x1874258609552512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432900.558812:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b140c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+18:3642:x1874258609552512:12345-0@lo:400:kworker.0 Request processed in 60us (3128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432900.558836:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787432900.558873:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609553024 00000100:00100000:2.0:1787432900.558878:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609553024 00000100:00100000:2.0:1787432900.559015:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609552768 00000100:00100000:2.0:1787432900.559019:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609552768 00000100:00100000:1.0:1787432900.559055:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432900.559065:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609553024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432900.559101:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609553024:12345-0@lo:400:kworker.0 Request processed in 39us (3330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432900.559119:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432900.559516:0:22723:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1787432900.559525:0:22723:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1787432900.559545:0:22720:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787432900.559550:0:22720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787432900.559800:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432900.559810:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609552768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432900.559858:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609552768:12345-0@lo:400:kworker.0 Request processed in 51us (4032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432900.559874:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787432900.559914:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94843f923b80 x1874258609552768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432900.559927:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609552768:0@lo:400:kworker.0 00000100:00100000:3.0:1787432900.560064:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609553152 00000100:00100000:3.0:1787432900.560069:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609553152 00000100:00100000:3.0:1787432900.560154:0:23798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787432900.560161:0:23798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609553152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432900.560221:0:23798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787432900.560262:0:23798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609553152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (2741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432900.560268:0:23798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787432900.560738:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609553152:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787432900.560807:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94843f922300 x1874258609553024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432900.560818:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609553024:0@lo:400:kworker.0 00000100:00100000:2.0:1787432900.560826:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a13c04c-dd5b-4f06-b031-814868f35d81:3642:1874258609552512:0@lo:400:kworker.0 00000100:00080000:2.0:1787432900.570755:0:22724:0:(import.c:65:import_set_state_nolock()) ffff948409e95000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432900.570846:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874258609552640:12345-0@lo:38:kworker.0 Request processed in 13887us (14843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432900.570857:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787432900.571353:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1787432900.571431:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787432900.571439:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787432900.571442:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843f86d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1787432900.571460:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000066275862): req@ffff94843f920a80 x1874258609545728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432900.571475:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609552640:0@lo:38:kworker.0 00000100:00100000:1.0:1787432900.572301:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432900.572331:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432900.572343:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432900.572355:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609553280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432900.572451:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432900.572479:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609545728 00000100:00100000:1.0:1787432900.572486:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609545728 00000100:00100000:1.0:1787432900.572521:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609553280 00000100:00100000:1.0:1787432900.572524:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609553280 00000100:00100000:1.0:1787432900.572537:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432900.572545:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22761:x1874258609545728:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787432900.572610:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22761:x1874258609545728:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 65us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432900.572617:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432900.572631:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787432900.572637:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874258609553280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787432900.572680:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787432900.572716:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874258609553280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432900.572723:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787432900.572758:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609553280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432900.572783:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22761:1874258609545728:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787432900.572811:0:22761:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787432900.572840:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22761:1874258609553408:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787432900.572864:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432900.572883:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484122bf240 going to sleep for 11 seconds 00000100:00100000:1.0:1787432900.572891:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609553408 00000100:00100000:1.0:1787432900.572894:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609553408 00000100:00100000:1.0:1787432900.572910:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432900.572915:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22761:x1874258609553408:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787432900.574799:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22761:x1874258609553408:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 1871us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432900.574812:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787432900.578352:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22761:1874258609553408:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787432900.578545:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22761:1874258609553536:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787432900.578602:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432900.579299:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff948402ac7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432900.581544:0:23798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609553536 00000100:00100000:1.0:1787432900.581557:0:23798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609553536 00000100:00100000:1.0:1787432900.581619:0:23798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787432900.581631:0:23798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22761:x1874258609553536:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787432900.581759:0:23798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22761:x1874258609553536:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 129us (3155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432900.581767:0:23798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787432900.583335:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22761:1874258609553536:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787432900.583413:0:22761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432900.589866:0:22761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787432900.589954:0:22761:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:0.0:1787432900.589960:0:22761:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787432900.747322:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787432900.787415:0:23825:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787432900.787621:0:23825:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787432901.772204:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787432901.903135:0:23873:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff528fcbd0 20000000:00000080:1.0:1787432901.903155:0:23873:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9484271d6400 uarg=0000000000000000 20000000:01000000:1.0:1787432901.905519:0:23873:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787432901.905531:0:23873:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787432901.905536:0:23873:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787432901.910748:0:23874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787432901.911028:0:23873:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787432901.925245:0:23873:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787432901.925339:0:23873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9484013fd000/0xca72b3b335640718 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432901.925358:0:23873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948302690c00/0xca72b3b3356405c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356405ba expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432901.925366:0:23873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94843f85f600/0xca72b3b3356406c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356406bd expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432901.925374:0:23873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9484013fd000/0xca72b3b335640718 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432901.925417:0:23873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94843f85f600/0xca72b3b3356406c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b3356406bd expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432901.925431:0:23873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94843f85f600/0xca72b3b3356406c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b3356406bd expref: 17 pid: 22714 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432901.925445:0:23873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23873:1874258609553664:0@lo:104: 00000100:00100000:0.0:1787432901.925515:0:23873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432901.925965:0:23873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948302690c00/0xca72b3b3356405c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b3356405ba expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432901.925974:0:23873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948302690c00/0xca72b3b3356405c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b3356405ba expref: 17 pid: 22714 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432901.926008:0:23873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23873:1874258609553792:0@lo:104: 00000100:00100000:0.0:1787432901.926034:0:23873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432901.930421:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609553664 00000100:00100000:2.0:1787432901.930435:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609553664 00000100:00100000:2.0:1787432901.931287:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609553792 00000100:00100000:2.0:1787432901.931295:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609553792 00000100:00100000:2.0:1787432901.931319:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787432901.931342:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434898700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+4:23873:x1874258609553664:12345-0@lo:104: 00010000:00010000:2.0:1787432901.931360:0:22703:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b3356406bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356406c4 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.931443:0:22703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787432901.931450:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434898700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+4:23873:x1874258609553664:12345-0@lo:104: Request processed in 122us (5934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432901.931472:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787432901.931600:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432901.931608:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b3356406bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356406c4 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432901.931616:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ec00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1787432901.931620:0:22708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b3356406bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b3356406c4 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432901.931628:0:22708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b3356406bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b3356406c4 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432901.931645:0:22708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b3356406bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b3356406c4 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432901.931662:0:22708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787432901.931703:0:22708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b3356406bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356406c4 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432901.931710:0:22708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432901.931731:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b3356406bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356406c4 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432901.931737:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b3356406bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356406c4 expref: -99 pid: 23452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432901.931749:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432901.931751:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432901.931753:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432901.931788:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a13c04c-dd5b-4f06-b031-814868f35d81:3644:1874258609553920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432901.931799:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787432901.931806:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+3:23873:x1874258609553792:12345-0@lo:104: 00010000:00010000:2.0:1787432901.931814:0:22703:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948301f05400/0xca72b3b3356405ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356405c1 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432901.931825:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432901.931846:0:22703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787432901.931851:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+3:23873:x1874258609553792:12345-0@lo:104: Request processed in 46us (5818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432901.931857:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787432901.931868:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787432901.931871:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609553920 00010000:00010000:2.0:1787432901.931872:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948301f05400/0xca72b3b3356405ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356405c1 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432901.931875:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609553920 00010000:00010000:2.0:1787432901.931878:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f05400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432901.931881:0:22707:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948301f05400/0xca72b3b3356405ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b3356405c1 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.931887:0:22707:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948301f05400/0xca72b3b3356405ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b3356405c1 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432901.931893:0:22706:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94843f85f600/0xca72b3b3356406c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356406bd expref: 18 pid: 22714 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432901.931893:0:22707:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948301f05400/0xca72b3b3356405ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b3356405c1 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432901.931899:0:22707:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787432901.931913:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432901.931919:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840356ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a13c04c-dd5b-4f06-b031-814868f35d81+18:3644:x1874258609553920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432901.931929:0:22706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432901.931934:0:22706:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94843f85f600/0xca72b3b3356406c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356406bd expref: 18 pid: 22714 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432901.931944:0:22706:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94843f85f600/0xca72b3b3356406c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b3356406bd expref: 18 pid: 22714 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432901.931970:0:22706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432901.932010:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840356ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a13c04c-dd5b-4f06-b031-814868f35d81+18:3644:x1874258609553920:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432901.932017:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432901.932063:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a13c04c-dd5b-4f06-b031-814868f35d81:3644:1874258609553920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432901.934065:0:23873:0:(client.c:2715:ptlrpc_set_wait()) set ffff948402ac7780 going to sleep for 11 seconds 00010000:00010000:1.0:1787432901.934108:0:23873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94843f85f600/0xca72b3b3356406c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b3356406bd expref: 17 pid: 22714 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432901.934123:0:23873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434899180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23873:1874258609553664:0@lo:104: 00000100:00100000:1.0:1787432901.934134:0:23873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23873:1874258609553792:0@lo:104: 00010000:00010000:1.0:1787432901.934156:0:23873:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9484013fd000/0xca72b3b335640718 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.935134:0:22707:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948301f05400/0xca72b3b3356405ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356405c1 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.935147:0:22707:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432901.935256:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948301f05400/0xca72b3b3356405ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356405c1 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.935264:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948301f05400/0xca72b3b3356405ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356405c1 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432901.935794:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432901.935819:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a13c04c-dd5b-4f06-b031-814868f35d81:3642:1874258609554048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432901.935891:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432901.936210:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432901.936213:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432901.936215:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432901.936221:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609554048 00000100:00100000:2.0:1787432901.936229:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609554048 00010000:00010000:2.0:1787432901.936265:0:22705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948302690c00/0xca72b3b3356405c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356405ba expref: 17 pid: 22714 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432901.936302:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787432901.936312:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+17:3642:x1874258609554048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432901.936334:0:22705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432901.936340:0:22705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948302690c00/0xca72b3b3356405c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356405ba expref: 17 pid: 22714 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.936353:0:22705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948302690c00/0xca72b3b3356405c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b3356405ba expref: 17 pid: 22714 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.936372:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948302690c00/0xca72b3b3356405c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b3356405ba expref: 17 pid: 22714 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.936388:0:22705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9484013fd000/0xca72b3b335640718 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.936396:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fd000/0xca72b3b335640718 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.936412:0:22705:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484013fd000/0xca72b3b335640718 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.936434:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484013fd000/0xca72b3b335640718 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.936441:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9484013fd000/0xca72b3b335640718 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.936448:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9484013fd000/0xca72b3b335640718 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.936455:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fd000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432901.936459:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9484013fd000/0xca72b3b335640718 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.936468:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9484013fd000/0xca72b3b335640718 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.936490:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9484013fd000/0xca72b3b335640718 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432901.936501:0:22705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432901.936548:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+16:3642:x1874258609554048:12345-0@lo:103:ldlm_bl.0 Request processed in 237us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432901.936556:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787432901.936571:0:23873:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9484013fd000/0xca72b3b335640718 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432901.936579:0:23873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9484013fd000/0xca72b3b335640718 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432901.936585:0:23873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fd000/0xca72b3b335640718 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432901.936590:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a13c04c-dd5b-4f06-b031-814868f35d81:3642:1874258609554048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432902.797442:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787432903.755245:0:22716:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787432903.755254:0:22716:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94840557e000 from 13 10000000:01000000:3.0:1787432903.755260:0:22716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432903.755313:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33564071f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432903.755325:0:22716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33564071f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432903.755340:0:22716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33564071f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432903.755372:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609554176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432903.755482:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432903.755536:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432903.756227:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609554176 00000100:00100000:2.0:1787432903.756236:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609554176 00000100:00100000:2.0:1787432903.756297:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787432903.756312:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+16:22716:x1874258609554176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432903.756341:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432903.756362:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948301f04000/0xca72b3b335640726 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33564071f expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432903.756399:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948301f04000/0xca72b3b335640726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33564071f expref: 17 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432903.756414:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948301f04000/0xca72b3b335640726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564071f expref: 17 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432903.756427:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f04000, rc 0) 00000100:00100000:2.0:1787432903.756733:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+17:22716:x1874258609554176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 426us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432903.756740:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787432903.758093:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609554176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432903.758118:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33564071f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640726 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432903.758129:0:22716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33564071f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640726 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432903.764056:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609554304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432903.764141:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432903.764280:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432903.765745:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609554304 00000100:00100000:2.0:1787432903.765756:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609554304 00000100:00100000:2.0:1787432903.765815:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787432903.765825:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+17:22716:x1874258609554304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432903.766000:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+17:22716:x1874258609554304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432903.766009:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787432903.766076:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609554304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432903.766128:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609554432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432903.766193:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432903.766212:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff948420669240 going to sleep for 11 seconds 00000100:00100000:2.0:1787432903.766225:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609554432 00000100:00100000:2.0:1787432903.766229:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609554432 00000100:00100000:2.0:1787432903.766259:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787432903.766266:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843daa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+17:22716:x1874258609554432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432903.766356:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843daa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+17:22716:x1874258609554432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432903.766364:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787432903.766406:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609554432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787432903.767044:0:23972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787432903.767094:0:22716:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787432903.767116:0:22716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432903.767126:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33564071f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640726 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432903.767136:0:22716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33564071f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640726 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432903.767147:0:22716:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787432903.767149:0:22716:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94844112f000 from 13 10000000:01000000:2.0:1787432903.767152:0:22716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787432903.767196:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f04600/0xca72b3b33564072d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432903.767205:0:22716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948301f04600/0xca72b3b33564072d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432903.767213:0:22716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948301f04600/0xca72b3b33564072d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432903.767227:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609554560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432903.767258:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432903.767284:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484206693c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432903.767299:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609554560 00000100:00100000:2.0:1787432903.767303:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609554560 00000100:00100000:2.0:1787432903.767331:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787432903.767338:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843daa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+17:22716:x1874258609554560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432903.767346:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432903.767358:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948301f05a00/0xca72b3b335640734 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33564072d expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432903.767382:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948301f05a00/0xca72b3b335640734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33564072d expref: 18 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432903.767391:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948301f05a00/0xca72b3b335640734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564072d expref: 18 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432903.767399:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f05a00, rc 0) 00000100:00100000:2.0:1787432903.767428:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843daa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+18:22716:x1874258609554560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432903.767434:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787432903.767465:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609554560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432903.767477:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948301f04600/0xca72b3b33564072d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640734 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432903.767485:0:22716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948301f04600/0xca72b3b33564072d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640734 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432903.767526:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609554688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432903.767548:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432903.767566:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112df900 going to sleep for 11 seconds 00000100:00100000:2.0:1787432903.767576:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609554688 00000100:00100000:2.0:1787432903.767578:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609554688 00000100:00100000:2.0:1787432903.767606:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787432903.767612:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843daa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+18:22716:x1874258609554688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432903.767683:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843daa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+18:22716:x1874258609554688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432903.767689:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787432903.767717:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609554688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432903.767738:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609554816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432903.767776:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432903.767788:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112df900 going to sleep for 11 seconds 00000100:00100000:2.0:1787432903.767798:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609554816 00000100:00100000:2.0:1787432903.767802:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609554816 00000100:00100000:2.0:1787432903.767821:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787432903.767827:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843daa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+18:22716:x1874258609554816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432903.767885:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843daa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+18:22716:x1874258609554816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432903.767891:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787432903.767921:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609554816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787432903.770542:0:23973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787432903.771323:0:22716:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787432903.771350:0:22716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787432903.771361:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f04600/0xca72b3b33564072d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640734 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432903.771372:0:22716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948301f04600/0xca72b3b33564072d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640734 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432903.819712:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787432904.268807:0:22754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787432904.844350:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432905.676592:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432895/real 1787432895] req@ffff94843f920700 x1874258609548928/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432905 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432905.676622:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94843f920700 x1874258609548928/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432905 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432905.676646:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432895/real 1787432895] req@ffff94843f921880 x1874258609548800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432905 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432905.676659:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94843f921880 x1874258609548800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432905 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787432905.676677:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432905.676686:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787432905.676690:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609548928:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787432905.676696:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948434880800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432905.676700:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787432905.676703:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609548800:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787432905.676789:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609554944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432905.676852:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432905.676899:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609554944 00000100:00100000:1.0:1787432905.676906:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609554944 00000100:00100000:1.0:1787432905.676948:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787432905.676956:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609554944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787432905.676990:0:22724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787432905.677034:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609554944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432905.677041:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787432905.677096:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609554944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432905.677387:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432905.677398:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609555072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787432905.677432:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432905.677617:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609555072 00000100:00100000:1.0:1787432905.677621:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609555072 00000100:00100000:1.0:1787432905.677664:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787432905.677672:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874258609555072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787432905.677689:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787432905.677721:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874258609555072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432905.677727:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787432905.677852:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609555072:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1787432905.678251:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432905.678351:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432905.678354:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432905.678357:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432905.678386:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432905.678390:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787432905.678392:0:8:0:(import.c:65:import_set_state_nolock()) ffff948434880800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432905.678397:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 706 00000100:00080000:0.0:1787432905.678401:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787432905.678406:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff948434880800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432905.678427:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94842726c700 x1874258609555456/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432905.678440:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432905.678443:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787432905.678451:0:8:0:(import.c:65:import_set_state_nolock()) ffff94843c7f0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432905.678455:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 706 00000100:00080000:0.0:1787432905.678457:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787432905.678461:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94843c7f0000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432905.678473:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94842726df80 x1874258609555584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787432905.678645:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609555328:0@lo:400:kworker.0 00000100:00100000:2.0:1787432905.678686:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432905.678719:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432905.678725:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609555712:0@lo:400:kworker.0 00000100:00100000:2.0:1787432905.678746:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432905.678773:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609555328 00000100:00100000:2.0:1787432905.678778:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609555328 00000100:00100000:2.0:1787432905.678810:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609555712 00000100:00100000:2.0:1787432905.678814:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609555712 00000100:00100000:2.0:1787432905.678831:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787432905.678839:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609555328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432905.678880:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609555328:12345-0@lo:400:kworker.0 Request processed in 41us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432905.678886:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787432905.678900:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432905.678906:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609555712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432905.678932:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609555712:12345-0@lo:400:kworker.0 Request processed in 26us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432905.678937:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787432905.678968:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94842726d180 x1874258609555712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432905.678979:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609555712:0@lo:400:kworker.0 00010000:00080000:2.0:1787432905.678990:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94842726ca80 x1874258609555328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432905.678997:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609555328:0@lo:400:kworker.0 00000100:00100000:1.0:1787432905.679195:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432905.679205:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a13c04c-dd5b-4f06-b031-814868f35d81:3643:1874258609555200:0@lo:400:kworker.0 00000100:00100000:1.0:1787432905.679238:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432905.679283:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609555456:0@lo:8:kworker.0 00000400:00000100:1.0:1787432905.679307:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609555456 offset 0 length 520: 4 00000100:00100000:1.0:1787432905.679319:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609555584:0@lo:8:kworker.0 00000400:00000100:1.0:1787432905.679337:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609555584 offset 0 length 520: 4 00000100:00100000:0.0:1787432905.679501:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609555200 00000100:00100000:0.0:1787432905.679505:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609555200 00000100:00100000:0.0:1787432905.679537:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787432905.679543:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843daa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+18:3643:x1874258609555200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432905.679992:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843daa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+18:3643:x1874258609555200:12345-0@lo:400:kworker.0 Request processed in 448us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432905.680000:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787432905.680101:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a13c04c-dd5b-4f06-b031-814868f35d81:3643:1874258609555200:0@lo:400:kworker.0 00000001:00100000:0.0:1787432905.680245:0:23453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787432905.867313:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432906.896005:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787432907.469546:0:24221:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787432907.469550:0:24221:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787432907.469552:0:24221:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787432907.469672:0:24221:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9484122e5800 00000020:01000004:2.0:1787432907.469689:0:24221:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787432907.469703:0:24221:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787432907.469717:0:24221:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff94843b9599b8) 00000020:00000080:2.0:1787432907.470632:0:24221:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787432907.529538:0:24221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787432907.532830:0:24221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787432907.534032:0:24221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787432907.534350:0:24221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787432907.534554:0:24221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787432907.534745:0:24221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787432907.534992:0:24221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1787432907.536568:0:24221:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787432907.536772:0:24221:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787432907.536785:0:24221:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787432907.536798:0:24221:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xca72b3b335640742 00000020:01000004:1.0:1787432907.536805:0:24221:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787432907.536828:0:24221:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.124@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787432907.536832:0:24221:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787432907.536847:0:24221:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787432907.536852:0:24221:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787432907.536865:0:24221:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff94843365b370) 00000020:00000080:1.0:1787432907.536878:0:24221:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1787432907.538694:0:24221:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787432907.539088:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787432907.539097:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787432907.544467:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787432907.544482:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787432907.545352:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787432907.545363:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787432907.548466:0:24221:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432907.548691:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787432907.548699:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787432907.549132:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787432907.549139:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787432907.570158:0:24221:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432907.570580:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787432907.570588:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787432907.571919:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787432907.571931:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787432907.576776:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787432907.576792:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787432907.583402:0:24221:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787432907.583618:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787432907.583625:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787432907.584658:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787432907.584669:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787432907.645054:0:24221:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432907.645768:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787432907.645776:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787432907.648940:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787432907.648957:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787432907.649634:0:24221:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787432907.649664:0:24221:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787432907.649678:0:24221:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.124@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787432907.664006:0:24221:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.124@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787432907.664119:0:24221:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.124@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787432907.664125:0:24221:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787432907.664127:0:24221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787432907.664128:0:24221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432907.664129:0:24221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432907.664130:0:24221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432907.664131:0:24221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432907.664133:0:24221:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432907.664135:0:24221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432907.664137:0:24221:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787432907.664140:0:24221:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787432907.664143:0:24221:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787432907.664144:0:24221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787432907.664145:0:24221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432907.664146:0:24221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432907.664147:0:24221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432907.664148:0:24221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432907.664149:0:24221:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432907.664150:0:24221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432907.664151:0:24221:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787432907.664280:0:24221:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787432907.664303:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609555840:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787432907.664373:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432907.664421:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bb6600 going to sleep for 11 seconds 00000100:00100000:2.0:1787432907.664452:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609555840 00000100:00100000:2.0:1787432907.664460:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609555840 00000100:00100000:2.0:1787432907.664530:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787432907.664540:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843daa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+18:24221:x1874258609555840:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787432907.664571:0:22711:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787432907.664574:0:22711:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787432907.664578:0:22711:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787432907.664951:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843daa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+18:24221:x1874258609555840:12345-0@lo:253:mount.lustre.0 Request processed in 411us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432907.664958:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787432907.665158:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609555840:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787432907.665361:0:24221:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787432907.665365:0:24221:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787432907.665366:0:24221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787432907.665368:0:24221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432907.665369:0:24221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432907.665370:0:24221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432907.665371:0:24221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432907.665372:0:24221:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432907.665374:0:24221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432907.665385:0:24221:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787432907.665404:0:24221:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9484122e5800 from lustre-OST0000 10000000:01000000:3.0:1787432907.665429:0:24221:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787432907.665431:0:24221:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787432907.665439:0:24221:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94843b95cd28 local copy 00010000:00010000:3.0:1787432907.665449:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640504 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432907.665783:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609555968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432907.665818:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432907.665853:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bb6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432907.665883:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609555968 00000100:00100000:0.0:1787432907.665888:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609555968 00000100:00100000:0.0:1787432907.665982:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787432907.665992:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+18:24221:x1874258609555968:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432907.666072:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+18:24221:x1874258609555968:12345-0@lo:501:mount.lustre.0 Request processed in 81us (253us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787432907.666079:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787432907.666155:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609555968:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787432907.666226:0:24221:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787432907.666244:0:24221:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787432907.666250:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640504 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432907.666259:0:24221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640504 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432907.666281:0:24221:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9484122e5800 10000000:01000000:3.0:1787432907.666286:0:24221:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787432907.666291:0:24221:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787432907.666293:0:24221:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787432907.666297:0:24221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787432907.666300:0:24221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787432907.666321:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432907.666329:0:24221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432907.666344:0:24221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432907.666356:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556096:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432907.666603:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432907.666674:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bb6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432907.666710:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609556096 00000100:00100000:2.0:1787432907.666714:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609556096 00000100:00100000:2.0:1787432907.666750:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787432907.666758:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+18:24221:x1874258609556096:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432907.666766:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432907.666778:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948301f05800/0xca72b3b335640757 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b335640750 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432907.666799:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948301f05800/0xca72b3b335640757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b335640750 expref: 19 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432907.666816:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948301f05800/0xca72b3b335640757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b335640750 expref: 19 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432907.666824:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f05800, rc 0) 00000100:00100000:2.0:1787432907.666944:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+19:24221:x1874258609556096:12345-0@lo:101:mount.lustre.0 Request processed in 186us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432907.666951:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787432907.667009:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556096:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432907.667021:0:24221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640757 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432907.667030:0:24221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640757 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787432907.668974:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1787432907.672849:0:24221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432907.676127:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787432907.677030:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1787432907.677046:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1787432907.677059:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1787432907.677093:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1787432907.677107:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1787432907.677119:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1787432907.677131:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1787432907.677142:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1787432907.677153:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1787432907.677195:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1787432907.677211:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1787432907.677247:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1787432907.677253:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1787432907.677371:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432907.677467:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432907.677512:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302773180 going to sleep for 11 seconds 00000100:00100000:0.0:1787432907.677845:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609556224 00000100:00100000:0.0:1787432907.677852:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609556224 00000100:00100000:0.0:1787432907.677909:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787432907.677929:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+19:24221:x1874258609556224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432907.678083:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+19:24221:x1874258609556224:12345-0@lo:501:mount.lustre.0 Request processed in 156us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432907.678091:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787432907.678757:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432907.678799:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556352:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787432907.678856:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432907.678889:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302773180 going to sleep for 11 seconds 00000100:00100000:3.0:1787432907.678942:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609556352 00000100:00100000:3.0:1787432907.678946:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609556352 00000100:00100000:3.0:1787432907.678986:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787432907.678994:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+19:24221:x1874258609556352:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432907.680337:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+19:24221:x1874258609556352:12345-0@lo:503:mount.lustre.0 Request processed in 1338us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432907.680348:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787432907.680466:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556352:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787432907.680907:0:24221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787432907.680982:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556480:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432907.681025:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432907.681067:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff948402ac7900 going to sleep for 11 seconds 00000100:00100000:3.0:1787432907.681273:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609556480 00000100:00100000:3.0:1787432907.681280:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609556480 00000100:00100000:3.0:1787432907.681309:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787432907.681317:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+19:24221:x1874258609556480:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432907.683723:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+19:24221:x1874258609556480:12345-0@lo:502:mount.lustre.0 Request processed in 2397us (2687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432907.683739:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787432907.683923:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556480:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432907.684159:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787432907.684231:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1787432907.684269:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1787432907.684284:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1787432907.684296:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1787432907.684386:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1787432907.684545:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1787432907.684560:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1787432907.684573:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1787432907.684585:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1787432907.684596:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1787432907.684607:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1787432907.684643:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556608:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432907.684695:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432907.684729:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff948402ac7900 going to sleep for 11 seconds 00000100:00100000:3.0:1787432907.684994:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609556608 00000100:00100000:3.0:1787432907.685008:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609556608 00000100:00100000:3.0:1787432907.685048:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787432907.685057:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+19:24221:x1874258609556608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432907.685288:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+19:24221:x1874258609556608:12345-0@lo:502:mount.lustre.0 Request processed in 108us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432907.685297:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787432907.685671:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556608:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432907.685726:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1787432907.685735:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787432907.686915:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787432907.686934:0:24238:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787432907.686949:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432907.686951:0:24238:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787432907.686957:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787432907.686973:0:24238:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9483031a99b8) 00000020:00000080:2.0:1787432907.687000:0:24238:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787432907.687007:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787432907.687087:0:24238:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9484122e5800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787432907.687095:0:24238:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787432907.687102:0:24238:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xca72b3b335640765 00010000:00010000:2.0:1787432907.694915:0:24238:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1787432907.695427:0:24238:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1787432907.698871:0:24238:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1787432907.700827:0:24238:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787432907.700841:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432907.700848:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432907.700850:0:24238:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787432907.700853:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787432907.700856:0:24238:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1787432907.700857:0:24238:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787432907.700859:0:24238:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787432907.700860:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787432907.700863:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432907.700864:0:24238:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787432907.700866:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432907.700869:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432907.700870:0:24238:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787432907.700874:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787432907.700876:0:24238:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787432907.700878:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432907.700880:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432907.700882:0:24238:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787432907.700884:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432907.700886:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432907.700893:0:24238:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787432907.700897:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787432907.700929:0:24238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432907.700933:0:24238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432907.700935:0:24238:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787432907.700938:0:24238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1787432907.701213:0:24221:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787432907.701250:0:24221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787432907.701270:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640757 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432907.701286:0:24221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640757 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432907.701295:0:24221:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9484122e5800 from 1 10000000:01000000:3.0:1787432907.701298:0:24221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432907.701354:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b33564076c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432907.701363:0:24221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b33564076c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432907.701375:0:24221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b33564076c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432907.701423:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556736:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432907.701507:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432907.701564:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff948304743f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432907.701912:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609556736 00000100:00100000:1.0:1787432907.701921:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609556736 00000100:00100000:1.0:1787432907.701974:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787432907.701986:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+19:24221:x1874258609556736:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432907.702000:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432907.702014:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302690400/0xca72b3b335640773 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33564076c expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432907.702038:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302690400/0xca72b3b335640773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33564076c expref: 20 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432907.702049:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302690400/0xca72b3b335640773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564076c expref: 20 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432907.702059:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302690400, rc 0) 00000100:00100000:1.0:1787432907.702104:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+20:24221:x1874258609556736:12345-0@lo:101:mount.lustre.0 Request processed in 120us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432907.702124:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787432907.703028:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556736:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432907.703054:0:24221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b33564076c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640773 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432907.703064:0:24221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b33564076c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640773 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787432907.706750:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1787432907.707097:0:24221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432907.708695:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1787432907.708758:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1787432907.708776:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1787432907.708818:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1787432907.708833:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1787432907.708846:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1787432907.708862:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1787432907.708877:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1787432907.708891:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1787432907.708903:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1787432907.708917:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1787432907.708942:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1787432907.708948:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1787432907.709059:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432907.709135:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432907.712546:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609556864 00000100:00100000:2.0:1787432907.712559:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609556864 00000100:00100000:2.0:1787432907.712614:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787432907.712623:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+20:24221:x1874258609556864:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432907.712674:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432907.712821:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+20:24221:x1874258609556864:12345-0@lo:501:mount.lustre.0 Request processed in 198us (3684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432907.712831:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787432907.713233:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432907.713286:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556992:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432907.713549:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432907.713581:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432907.713792:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609556992 00000100:00100000:2.0:1787432907.713798:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609556992 00000100:00100000:2.0:1787432907.715693:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787432907.715714:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+20:24221:x1874258609556992:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787432907.715902:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+20:24221:x1874258609556992:12345-0@lo:503:mount.lustre.0 Request processed in 195us (2353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432907.715911:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787432907.716160:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609556992:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787432907.716753:0:24221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787432907.716838:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609557120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432907.718107:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432907.718189:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432907.718659:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609557120 00000100:00100000:2.0:1787432907.718667:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609557120 00000100:00100000:2.0:1787432907.718742:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787432907.718751:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+20:24221:x1874258609557120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432907.718883:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+20:24221:x1874258609557120:12345-0@lo:502:mount.lustre.0 Request processed in 133us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432907.718890:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787432907.718978:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609557120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787432907.719203:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787432907.719238:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1787432907.719250:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1787432907.719261:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1787432907.719285:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1787432907.719297:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1787432907.719316:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1787432907.719328:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1787432907.719338:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1787432907.719362:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1787432907.719376:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1787432907.719419:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609557248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432907.719465:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432907.721378:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432907.726995:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609557248 00000100:00100000:0.0:1787432907.727010:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609557248 00000100:00100000:0.0:1787432907.727082:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787432907.727093:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+20:24221:x1874258609557248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432907.727302:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+20:24221:x1874258609557248:12345-0@lo:502:mount.lustre.0 Request processed in 210us (7835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432907.727396:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432892/real 1787432892] req@ffff94843489bb80 x1874258609546752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432907 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432907.727429:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94843489bb80 x1874258609546752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432907 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432907.727440:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432892/real 1787432892] req@ffff948434899880 x1874258609546880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432907 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432907.727464:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948434899880 x1874258609546880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432907 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787432907.727485:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843f868000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787432907.727677:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787432907.727682:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609546752:0@lo:8:kworker.0 00000100:00080000:2.0:1787432907.727688:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948304f08000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1787432907.727713:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787432907.727929:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432907.727934:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787432907.727937:0:8:0:(import.c:65:import_set_state_nolock()) ffff94843f868000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432907.727942:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 703 00000100:00080000:3.0:1787432907.727947:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787432907.727951:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94843f868000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432907.727969:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94840356b480 x1874258609557504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432907.727979:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432907.727982:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787432907.727983:0:8:0:(import.c:65:import_set_state_nolock()) ffff948304f08000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432907.727986:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 703 00000100:00080000:3.0:1787432907.727988:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787432907.727991:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948304f08000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432907.727998:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94840356b800 x1874258609557632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432907.728024:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432907.728027:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432907.728029:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432907.728039:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787432907.728068:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609557760:0@lo:400:kworker.0 00000100:00100000:3.0:1787432907.728104:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432907.728132:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432907.728137:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609557376:0@lo:400:kworker.0 00000100:00100000:3.0:1787432907.728158:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432907.728206:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609557888:0@lo:400:kworker.0 00000100:00100000:3.0:1787432907.728228:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432907.728252:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432907.728257:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609558016:0@lo:400:kworker.0 00000100:00100000:3.0:1787432907.728281:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432907.728297:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609557376 00000100:00100000:0.0:1787432907.728314:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609557376 00000100:00100000:3.0:1787432907.728320:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609557760 00000100:00100000:3.0:1787432907.728325:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609557760 00000100:00100000:0.0:1787432907.728349:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609557888 00000100:00100000:0.0:1787432907.728353:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609557888 00000100:00100000:0.0:1787432907.728371:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787432907.728378:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609557376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432907.728420:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609558016 00000100:00100000:3.0:1787432907.728424:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609558016 00000100:00100000:0.0:1787432907.728433:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609557376:12345-0@lo:400:kworker.0 Request processed in 53us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432907.728452:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787432907.728455:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787432907.728462:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840356bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609557760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432907.728474:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787432907.728483:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609557888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432907.728536:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609557888:12345-0@lo:400:kworker.0 Request processed in 55us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432907.728552:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787432907.728577:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840356bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609557760:12345-0@lo:400:kworker.0 Request processed in 116us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432907.728585:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432907.728601:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432907.728607:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840356aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609558016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432907.728634:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840356aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609558016:12345-0@lo:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432907.728640:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787432907.728684:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948403568e00 x1874258609558016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432907.728703:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609558016:0@lo:400:kworker.0 00000100:00100000:3.0:1787432907.728714:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609557888:0@lo:400:kworker.0 00000100:00100000:3.0:1787432907.728741:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609557376:0@lo:400:kworker.0 00010000:00080000:3.0:1787432907.728749:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948403569180 x1874258609557760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432907.728757:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609557760:0@lo:400:kworker.0 00000100:00080000:2.0:1787432907.728951:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787432907.728956:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609546880:0@lo:8:kworker.0 00000100:00100000:2.0:1787432907.728977:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609557504:0@lo:8:kworker.0 00000100:00100000:2.0:1787432907.729012:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787432907.729090:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432907.729094:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432907.729096:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432907.729099:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787432907.730231:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609557632:0@lo:8:kworker.0 00000100:00100000:2.0:1787432907.730274:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432907.730946:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609557248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787432907.731059:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1787432907.731073:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787432907.732536:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432907.732550:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432907.732553:0:24242:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787432907.732559:0:24242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9484122e5800 00000020:00000080:1.0:1787432907.732562:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787432907.732570:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432907.732573:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432907.732574:0:24242:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787432907.732577:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432907.732579:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432907.732581:0:24242:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787432907.732598:0:24242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9484122e5800 00000020:00000080:1.0:1787432907.732601:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787432907.732664:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432907.732669:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432907.732670:0:24242:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787432907.732673:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432907.732676:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432907.732677:0:24242:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787432907.732680:0:24242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9484122e5800 00000020:00000080:1.0:1787432907.732682:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787432907.732701:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432907.732703:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432907.732705:0:24242:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787432907.732707:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432907.732714:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432907.732716:0:24242:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787432907.732719:0:24242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9484122e5800 00000020:00000080:1.0:1787432907.732721:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787432907.732743:0:24242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432907.732746:0:24242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432907.732747:0:24242:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787432907.732750:0:24242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000100:00100000:0.0:1787432907.737335:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609557504 00000100:00100000:0.0:1787432907.737350:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609557504 00000100:00100000:0.0:1787432907.737407:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609557632 00000100:00100000:0.0:1787432907.737410:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609557632 00000100:00100000:0.0:1787432907.737427:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432907.737436:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1874258609557504:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787432907.737947:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1874258609557504:12345-0@lo:8:kworker.0 Request processed in 509us (8931us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787432907.737956:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432907.737976:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432907.737981:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1874258609557632:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787432907.737994:0:24225:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787432907.738025:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1874258609557632:12345-0@lo:8:kworker.0 Request processed in 43us (7751us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787432907.738031:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432907.738244:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787432907.738254:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843f868000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787432907.738259:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787432907.738264:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609557504:0@lo:8:kworker.0 00000100:00080000:2.0:1787432907.738276:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948304f08000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787432907.738280:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787432907.738292:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609557632:0@lo:8:kworker.0 00000020:01000000:3.0:1787432907.739590:0:24221:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787432907.739636:0:24221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787432907.739654:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b33564076c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640773 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432907.739669:0:24221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b33564076c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640773 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432907.739728:0:24221:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787432907.739731:0:24221:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9484122e5800 10000000:01000000:3.0:1787432907.739735:0:24221:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9484122e5800 10000000:01000000:3.0:1787432907.739739:0:24221:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787432907.739745:0:24221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9484122e5800 from 1 10000000:01000000:3.0:1787432907.739765:0:24221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787432907.739799:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33564077a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432907.740685:0:24221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33564077a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432907.740703:0:24221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33564077a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432907.740789:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403569180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609558144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432907.741313:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432907.741394:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609558144 00000100:00100000:2.0:1787432907.741402:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609558144 00000100:00100000:3.0:1787432907.741435:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484126b66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432907.741595:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787432907.741607:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+20:24221:x1874258609558144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432907.741623:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432907.741642:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948301f04c00/0xca72b3b335640781 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33564077a expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432907.741670:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948301f04c00/0xca72b3b335640781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33564077a expref: 21 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432907.741683:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948301f04c00/0xca72b3b335640781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564077a expref: 21 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432907.741692:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f04c00, rc 0) 00000100:00100000:2.0:1787432907.748835:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+21:24221:x1874258609558144:12345-0@lo:101:mount.lustre.0 Request processed in 7221us (7513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432907.748849:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787432907.750627:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403569180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609558144:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432907.750664:0:24221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33564077a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640781 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.750679:0:24221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33564077a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640781 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787432907.756270:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1787432907.756618:0:24221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432907.756851:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1787432907.756880:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1787432907.756911:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1787432907.756935:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1787432907.756954:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1787432907.757638:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1787432907.757670:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1787432907.757687:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1787432907.757699:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1787432907.757710:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1787432907.757723:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1787432907.757734:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1787432907.757745:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1787432907.757758:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1787432907.757769:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1787432907.757779:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1787432907.757789:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1787432907.757799:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1787432907.757809:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1787432907.757819:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1787432907.757829:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1787432907.757839:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1787432907.757850:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1787432907.757865:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1787432907.758267:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1787432907.758300:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1787432907.758317:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1787432907.758331:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1787432907.758344:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1787432907.758357:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1787432907.758370:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1787432907.758385:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1787432907.758414:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1787432907.758429:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1787432907.758442:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1787432907.758657:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1787432907.758679:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1787432907.758694:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1787432907.758709:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1787432907.758722:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1787432907.758735:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1787432907.758749:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1787432907.758763:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1787432907.758777:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1787432907.758791:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1787432907.758805:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1787432907.758819:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1787432907.758833:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1787432907.759107:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1787432907.759128:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1787432907.759146:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1787432907.759151:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1787432907.766571:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609558272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432907.766639:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432907.766685:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484126b6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432907.766691:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609558272 00000100:00100000:2.0:1787432907.766699:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609558272 00000100:00100000:2.0:1787432907.766759:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787432907.766769:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+21:24221:x1874258609558272:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432907.766931:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+21:24221:x1874258609558272:12345-0@lo:501:mount.lustre.0 Request processed in 163us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432907.766941:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787432907.767157:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609558272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432907.767228:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609558400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432907.767270:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432907.767296:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432907.767348:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609558400 00000100:00100000:0.0:1787432907.767353:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609558400 00000100:00100000:0.0:1787432907.767379:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787432907.767386:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+21:24221:x1874258609558400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432907.767480:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+21:24221:x1874258609558400:12345-0@lo:503:mount.lustre.0 Request processed in 94us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432907.767487:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787432907.767577:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609558400:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787432907.767954:0:24221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787432907.768016:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609558528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432907.768050:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432907.768094:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432907.768271:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609558528 00000100:00100000:3.0:1787432907.768281:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609558528 00000100:00100000:3.0:1787432907.768403:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787432907.768413:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+21:24221:x1874258609558528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432907.768533:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+21:24221:x1874258609558528:12345-0@lo:502:mount.lustre.0 Request processed in 122us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432907.768540:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787432907.768680:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609558528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787432907.768873:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787432907.768901:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1787432907.768915:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1787432907.768928:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1787432907.768957:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1787432907.768972:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1787432907.768984:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1787432907.768998:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1787432907.769009:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787432907.769020:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1787432907.769032:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1787432907.769044:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1787432907.769057:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1787432907.769072:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1787432907.769085:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1787432907.769097:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1787432907.769110:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1787432907.769123:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1787432907.769136:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1787432907.769148:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1787432907.769211:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1787432907.769226:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1787432907.769237:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1787432907.769248:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1787432907.769258:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1787432907.769269:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1787432907.769281:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1787432907.769293:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1787432907.769305:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1787432907.769318:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1787432907.769342:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1787432907.769356:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1787432907.769369:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1787432907.769383:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1787432907.769397:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1787432907.769413:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1787432907.769444:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1787432907.769544:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1787432907.769558:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1787432907.769573:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1787432907.769589:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1787432907.769604:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1787432907.769619:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1787432907.769634:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1787432907.769650:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1787432907.769669:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1787432907.769687:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1787432907.769703:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1787432907.769750:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609558656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432907.769803:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432907.769836:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432907.769911:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609558656 00000100:00100000:0.0:1787432907.769918:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609558656 00000100:00100000:0.0:1787432907.769962:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787432907.769973:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+21:24221:x1874258609558656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432907.770076:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+21:24221:x1874258609558656:12345-0@lo:502:mount.lustre.0 Request processed in 105us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432907.770083:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787432907.771200:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609558656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787432907.771373:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1787432907.771397:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1787432907.771424:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609558784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432907.772617:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432907.772654:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609558784 00000100:00100000:1.0:1787432907.772659:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432907.772662:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609558784 00000100:00100000:2.0:1787432907.772726:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787432907.772738:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+21:24221:x1874258609558784:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432907.773246:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+21:24221:x1874258609558784:12345-0@lo:502:mount.lustre.0 Request processed in 510us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432907.773257:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787432907.773657:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609558784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787432907.773729:0:24221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1787432907.773746:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787432907.778031:0:24248:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787432907.778065:0:24248:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9483031acd28) 00000020:00000080:2.0:1787432907.778092:0:24248:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1787432907.778192:0:24248:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9484122e5800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787432907.778197:0:24248:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9484122e5800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787432907.778200:0:24248:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9484122e5800 3 00010000:00080000:2.0:1787432907.778231:0:24248:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948409d2d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.124@tcp at head 00010000:00010000:2.0:1787432907.779970:0:24248:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1787432907.780222:0:24248:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787432907.780272:0:24248:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787432907.780286:0:24248:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xca72b3b33564078f 00000100:00080000:2.0:1787432907.780296:0:24248:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787432907.780302:0:24248:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff948409d2d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432907.780339:0:24248:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94843f920000 x1874258609558912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787432907.780381:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609558912:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787432907.780466:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787432907.780536:0:24248:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787432907.780560:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609558912 00000100:00100000:3.0:1787432907.780568:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609558912 00000100:00100000:3.0:1787432907.780610:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432907.780620:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1874258609558912:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787432907.780645:0:23799:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:3.0:1787432907.780669:0:23799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xca72b3b335640796 00000004:00100000:3.0:1787432907.780682:0:23799:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787432907.780708:0:23799:0:(import.c:65:import_set_state_nolock()) ffff9483039eb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432907.780775:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874258609558912:12345-0@lo:38:llog_process_th.0 Request processed in 155us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432907.780783:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787432907.780810:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432907.780814:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432907.780817:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432907.780820:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1787432907.780852:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94843f920000 x1874258609558912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432907.780862:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787432907.780869:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1787432907.780882:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787432907.780886:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787432907.780889:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948409d2d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787432907.780894:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609558912:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1787432907.781829:0:24248:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787432907.781849:0:24248:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff94841de999b8) 00000020:00000080:0.0:1787432907.781872:0:24248:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1787432907.781967:0:24248:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9484122e5800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787432907.781971:0:24248:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9484122e5800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787432907.781974:0:24248:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9484122e5800 3 00010000:00080000:0.0:1787432907.782006:0:24248:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9483032ed800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.124@tcp at head 00010000:00010000:0.0:1787432907.787251:0:24248:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1787432907.787475:0:24248:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787432907.787537:0:24248:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787432907.787551:0:24248:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xca72b3b3356407a4 00000100:00080000:0.0:1787432907.787561:0:24248:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787432907.787574:0:24248:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9483032ed800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432907.787608:0:24248:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94842726d500 x1874258609559040/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432907.787643:0:24248:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787432907.787809:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432907.787815:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432907.787818:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432907.787826:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787432907.787968:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874258609559040:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787432907.788053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432907.788151:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609559040 00000100:00100000:2.0:1787432907.788158:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609559040 00000100:00100000:2.0:1787432907.788222:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787432907.788231:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874258609559040:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787432907.788255:0:22719:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:2.0:1787432907.788289:0:22719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xca72b3b3356407ab 00000004:00100000:2.0:1787432907.788304:0:22719:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787432907.788336:0:22719:0:(import.c:65:import_set_state_nolock()) ffff9484166d2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432907.788403:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874258609559040:12345-0@lo:38:llog_process_th.0 Request processed in 172us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432907.788411:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787432907.788551:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94842726d500 x1874258609559040/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432907.788562:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787432907.788569:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1787432907.788575:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787432907.788579:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787432907.788581:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9483032ed800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787432907.788586:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874258609559040:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787432907.789544:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787432907.789701:0:24248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1787432907.789790:0:24221:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787432907.789821:0:24221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787432907.789842:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33564077a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640781 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432907.789854:0:24221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33564077a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640781 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787432907.789910:0:24221:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787432907.789913:0:24221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787432907.789914:0:24221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432907.789915:0:24221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432907.789916:0:24221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432907.789922:0:24221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432907.789924:0:24221:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432907.789926:0:24221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432907.789928:0:24221:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787432907.789931:0:24221:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787432907.789934:0:24221:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787432907.789935:0:24221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787432907.789937:0:24221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432907.789938:0:24221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432907.789939:0:24221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432907.789940:0:24221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432907.789940:0:24221:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432907.789941:0:24221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432907.789942:0:24221:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787432907.789966:0:24221:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787432907.789984:0:24221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609559168:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787432907.790048:0:24221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432907.790090:0:24221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484126b6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432907.790232:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609559168 00000100:00100000:0.0:1787432907.790240:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609559168 00000100:00100000:0.0:1787432907.790291:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787432907.790302:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+21:24221:x1874258609559168:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787432907.790326:0:22712:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787432907.790342:0:22712:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787432907.798265:0:22712:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787432907.798282:0:22712:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787432907.798403:0:22734:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787432907.798408:0:22734:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787432907.798430:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9484013fc000/0xca72b3b3356407b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.798461:0:22734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484013fd600/0xca72b3b3356406fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356406f5 expref: 21 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.798498:0:22734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484013fde00/0xca72b3b33564070a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b335640703 expref: 21 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.798506:0:22734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9484013fc000/0xca72b3b3356407b2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.798561:0:22734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484013fde00/0xca72b3b33564070a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b335640703 expref: 21 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.798589:0:22734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9484013fde00/0xca72b3b33564070a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b335640703 expref: 21 pid: 22714 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432907.798605:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22734:1874258609559296:0@lo:104: 00000100:00100000:0.0:1787432907.798673:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432907.798732:0:22734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484013fd600/0xca72b3b3356406fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b3356406f5 expref: 21 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.798740:0:22734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9484013fd600/0xca72b3b3356406fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b3356406f5 expref: 21 pid: 22714 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432907.798747:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22734:1874258609559424:0@lo:104: 00000100:00100000:0.0:1787432907.798768:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432907.798792:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841174fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432907.798862:0:22703:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787432907.798864:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+21:24221:x1874258609559168:12345-0@lo:253:mount.lustre.0 Request processed in 8562us (8813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432907.798878:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787432907.798884:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609559296 00000100:00100000:2.0:1787432907.798893:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609559296 00000100:00100000:2.0:1787432907.798948:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609559424 00000100:00100000:2.0:1787432907.798952:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609559424 00000100:00100000:2.0:1787432907.798967:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432907.798975:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+4:22734:x1874258609559296:12345-0@lo:104: 00010000:00010000:2.0:1787432907.798986:0:22703:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b335640703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33564070a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432907.799042:0:22703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787432907.799050:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+4:22734:x1874258609559296:12345-0@lo:104: Request processed in 75us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432907.799059:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432907.799084:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787432907.799091:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843d99d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+3:22734:x1874258609559424:12345-0@lo:104: 00010000:00010000:2.0:1787432907.799099:0:22703:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff94843f85e200/0xca72b3b3356406f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356406fc expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432907.799137:0:22703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787432907.799143:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843d99d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+3:22734:x1874258609559424:12345-0@lo:104: Request processed in 54us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432907.799150:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787432907.799251:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432907.799260:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b335640703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33564070a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432907.799271:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432907.799275:0:22707:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b335640703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33564070a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432907.799284:0:22707:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b335640703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33564070a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432907.799291:0:22707:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b335640703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33564070a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432907.799298:0:22707:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432907.799331:0:22707:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b335640703 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33564070a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432907.799338:0:22707:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432907.799359:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b335640703 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33564070a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432907.799366:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a13c04c-dd5b-4f06-b031-814868f35d81:3643:1874258609559552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432907.799369:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b335640703 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33564070a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432907.799385:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432907.799389:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff94843f85e200/0xca72b3b3356406f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356406fc expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432907.799395:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e200 already unused, calling callback (ffffffffc122fc20) 00000100:00100000:0.0:1787432907.799406:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1787432907.799408:0:22707:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff94843f85e200/0xca72b3b3356406f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b3356406fc expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432907.799418:0:22707:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff94843f85e200/0xca72b3b3356406f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b3356406fc expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432907.799426:0:22707:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff94843f85e200/0xca72b3b3356406f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b3356406fc expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432907.799432:0:22707:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432907.799451:0:22707:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff94843f85e200/0xca72b3b3356406f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356406fc expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432907.799456:0:22707:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432907.799473:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff94843f85e200/0xca72b3b3356406f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356406fc expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432907.799480:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff94843f85e200/0xca72b3b3356406f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356406fc expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432907.799491:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432907.799492:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432907.799493:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432907.799845:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432907.799938:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432907.799949:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a13c04c-dd5b-4f06-b031-814868f35d81:3643:1874258609559680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432907.799982:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432907.800244:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22734:1874258609559296:0@lo:104: 00000100:00100000:0.0:1787432907.800254:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22734:1874258609559424:0@lo:104: 00010000:00010000:0.0:1787432907.800274:0:22734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9484013fc000/0xca72b3b3356407b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432907.800304:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609559552 00000100:00100000:2.0:1787432907.800310:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609559552 00010000:00010000:2.0:1787432907.800336:0:22706:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484013fde00/0xca72b3b33564070a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b335640703 expref: 21 pid: 22714 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432907.800367:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609559680 00000100:00100000:2.0:1787432907.800370:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609559680 00010000:00010000:2.0:1787432907.800381:0:22706:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484013fd600/0xca72b3b3356406fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356406f5 expref: 22 pid: 22714 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432907.800399:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432907.800407:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787432907.800409:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a13c04c-dd5b-4f06-b031-814868f35d81+22:3643:x1874258609559552:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432907.800421:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435989050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+22:3643:x1874258609559680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432907.800423:0:22706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432907.800432:0:22706:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484013fde00/0xca72b3b33564070a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b335640703 expref: 22 pid: 22714 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.800436:0:22705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432907.800445:0:22705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484013fd600/0xca72b3b3356406fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356406f5 expref: 22 pid: 22714 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432907.800447:0:22706:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484013fde00/0xca72b3b33564070a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b335640703 expref: 22 pid: 22714 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432907.800465:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fde00/0xca72b3b33564070a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b335640703 expref: 22 pid: 22714 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432907.800489:0:22706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432907.800541:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a13c04c-dd5b-4f06-b031-814868f35d81+21:3643:x1874258609559552:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432907.800548:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432907.800578:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a13c04c-dd5b-4f06-b031-814868f35d81:3643:1874258609559552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432907.801231:0:22705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484013fd600/0xca72b3b3356406fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b3356406f5 expref: 20 pid: 22714 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.801243:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fd600/0xca72b3b3356406fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b3356406f5 expref: 20 pid: 22714 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.801256:0:22705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9484013fc000/0xca72b3b3356407b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.801264:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fc000/0xca72b3b3356407b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787432907.801278:0:22705:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012002050s 00010000:00010000:0.0:1787432907.801283:0:22705:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484013fc000/0xca72b3b3356407b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.801291:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484013fc000/0xca72b3b3356407b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.801299:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9484013fc000/0xca72b3b3356407b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.801307:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9484013fc000/0xca72b3b3356407b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.801321:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fc000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432907.801326:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9484013fc000/0xca72b3b3356407b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.801333:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9484013fc000/0xca72b3b3356407b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.801357:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9484013fc000/0xca72b3b3356407b2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432907.801367:0:22705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432907.801383:0:22734:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9484013fc000/0xca72b3b3356407b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432907.801393:0:22734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9484013fc000/0xca72b3b3356407b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432907.801400:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fc000/0xca72b3b3356407b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432907.801560:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435989050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+19:3643:x1874258609559680:12345-0@lo:103:ldlm_bl.0 Request processed in 1142us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432907.801567:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787432907.801673:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a13c04c-dd5b-4f06-b031-814868f35d81:3643:1874258609559680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787432907.801707:0:24221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:24221:1874258609559168:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787432907.801722:0:24221:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787432907.801725:0:24221:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787432907.801727:0:24221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787432907.801728:0:24221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432907.801729:0:24221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432907.801730:0:24221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432907.801731:0:24221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432907.801733:0:24221:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432907.801735:0:24221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432907.801737:0:24221:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787432907.801748:0:24221:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1787432907.805658:0:24221:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1787432907.808498:0:24221:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787432907.808511:0:24221:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787432907.808562:0:24221:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787432907.808609:0:24221:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.124@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787432907.808631:0:24221:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787432907.808659:0:24221:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787432907.810721:0:24221:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787432907.810997:0:24221:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787432907.915430:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787432908.591934:0:24301:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432908.592285:0:24301:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787432908.943736:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787432909.579230:0:22716:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787432909.579239:0:22716:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94840557e000 from 13 10000000:01000000:2.0:1787432909.579245:0:22716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787432909.579310:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b3356407b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432909.579323:0:22716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b3356407b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432909.579337:0:22716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b3356407b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432909.579368:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609559808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432909.579462:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432909.579530:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609559808 00000100:00100000:2.0:1787432909.579534:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432909.579539:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609559808 00000100:00100000:1.0:1787432909.579607:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787432909.579619:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+19:22716:x1874258609559808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432909.579634:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432909.579650:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302690000/0xca72b3b3356407c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b3356407b9 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432909.579675:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302690000/0xca72b3b3356407c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b3356407b9 expref: 20 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432909.579685:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302690000/0xca72b3b3356407c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356407b9 expref: 20 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432909.579693:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302690000, rc 0) 00000100:00100000:1.0:1787432909.579832:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+20:22716:x1874258609559808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432909.579843:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787432909.579857:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609559808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432909.579875:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b3356407b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356407c0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432909.579899:0:22716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b3356407b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b3356407c0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432909.579948:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609559936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787432909.579979:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432909.580004:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432909.580024:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609559936 00000100:00100000:1.0:1787432909.580029:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609559936 00000100:00100000:1.0:1787432909.580070:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787432909.580076:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+20:22716:x1874258609559936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787432909.580090:0:22712:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787432909.580107:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787432909.580110:0:22712:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1787432909.580309:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+20:22716:x1874258609559936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 231us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432909.580318:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787432909.581552:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609559936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787432909.581644:0:22716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787432909.581655:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b3356407b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356407c0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432909.581666:0:22716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b3356407b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356407c0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432909.581676:0:22716:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787432909.581679:0:22716:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94844112f000 from 13 10000000:01000000:0.0:1787432909.581682:0:22716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787432909.581717:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b3356407c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432909.581724:0:22716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b3356407c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432909.581746:0:22716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b3356407c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432909.582700:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609560064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787432909.584517:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432909.584753:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609560064 00000100:00100000:1.0:1787432909.584762:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609560064 00000100:00100000:1.0:1787432909.584941:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787432909.584951:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+20:22716:x1874258609560064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432909.584972:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432909.584996:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302690c00/0xca72b3b3356407ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b3356407c7 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432909.585028:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302690c00/0xca72b3b3356407ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b3356407c7 expref: 21 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432909.585040:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302690c00/0xca72b3b3356407ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356407c7 expref: 21 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432909.585050:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302690c00, rc 0) 00000100:00100000:1.0:1787432909.585111:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+21:22716:x1874258609560064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432909.585118:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787432909.586328:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484052eca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432909.586367:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609560064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432909.586411:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b3356407c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356407ce expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432909.586423:0:22716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b3356407c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b3356407ce expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432909.586507:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609560192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787432909.586562:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432909.586603:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841174f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432909.587977:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609560192 00000100:00100000:0.0:1787432909.587987:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609560192 00000100:00100000:0.0:1787432909.588037:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787432909.588047:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+21:22716:x1874258609560192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787432909.588069:0:22712:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787432909.588087:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787432909.588090:0:22712:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1787432909.589260:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+21:22716:x1874258609560192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1209us (2693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432909.589270:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787432909.589458:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609560192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787432909.589540:0:22716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787432909.589550:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b3356407c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356407ce expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432909.589560:0:22716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b3356407c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356407ce expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432909.964425:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432910.796626:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432910.796647:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609560320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432910.796716:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432910.796761:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609560320 00000100:00100000:0.0:1787432910.796769:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609560320 00000100:00100000:0.0:1787432910.796879:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787432910.796891:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609560320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432910.796931:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787432910.796982:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609560320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432910.797315:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787432910.797761:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609560320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432910.799843:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609560448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432910.799913:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432910.800123:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609560448 00000100:00100000:3.0:1787432910.800130:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609560448 00000100:00100000:3.0:1787432910.800215:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787432910.800226:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609560448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787432910.800258:0:22724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787432910.800309:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609560448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432910.800316:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787432910.800368:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609560448:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787432910.989640:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.016320:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787432912.844029:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432912.844036:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787432912.844040:0:8:0:(import.c:65:import_set_state_nolock()) ffff94843f868000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432912.844054:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94843f868000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432912.844076:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94843f920000 x1874258609560832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432912.844089:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432912.844092:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787432912.844094:0:8:0:(import.c:65:import_set_state_nolock()) ffff948304f08000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432912.844097:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 718 00000100:00080000:2.0:1787432912.844115:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787432912.844119:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948304f08000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432912.844131:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94843f921880 x1874258609560960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432912.844180:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432912.844183:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432912.844186:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432912.844188:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787432912.844257:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a13c04c-dd5b-4f06-b031-814868f35d81:3643:1874258609560576:0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.844322:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432912.844362:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609561344:0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.844389:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432912.844432:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787432912.844439:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609560704:0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.844468:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432912.844488:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609561472:0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.844510:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432912.844541:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609561088:0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.844563:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432912.844582:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609561600:0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.844604:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432912.844620:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432912.844625:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609561216:0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.844656:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432912.844690:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609560576 00000100:00100000:2.0:1787432912.844699:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609560576 00000100:00100000:2.0:1787432912.844742:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787432912.844751:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+21:3643:x1874258609560576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.844797:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+21:3643:x1874258609560576:12345-0@lo:400:kworker.0 Request processed in 47us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432912.844816:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787432912.844852:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609561344 00000100:00100000:2.0:1787432912.844855:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609561344 00000100:00100000:2.0:1787432912.844873:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609561472 00000100:00100000:2.0:1787432912.844875:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609561472 00000100:00100000:2.0:1787432912.844905:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609561088 00000100:00100000:2.0:1787432912.844908:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609561088 00000100:00100000:2.0:1787432912.844926:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609561600 00000100:00100000:2.0:1787432912.844928:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609561600 00000100:00100000:2.0:1787432912.844942:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787432912.844948:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609561344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.844982:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609561344:12345-0@lo:400:kworker.0 Request processed in 34us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432912.844988:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787432912.845001:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432912.845007:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609561472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.845035:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609561472:12345-0@lo:400:kworker.0 Request processed in 28us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432912.845041:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432912.845052:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432912.845058:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609561088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.845099:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609561088:12345-0@lo:400:kworker.0 Request processed in 41us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432912.845106:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432912.845122:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432912.845129:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609561600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.845155:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609561600:12345-0@lo:400:kworker.0 Request processed in 27us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432912.845160:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432912.845198:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609560704 00000100:00100000:2.0:1787432912.845202:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609560704 00000100:00100000:2.0:1787432912.845225:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609561216 00000100:00100000:2.0:1787432912.845227:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609561216 00000100:00100000:2.0:1787432912.845238:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787432912.845243:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609560704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.845274:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609560704:12345-0@lo:400:kworker.0 Request processed in 32us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432912.845279:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787432912.845289:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787432912.845294:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609561216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.845317:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609561216:12345-0@lo:400:kworker.0 Request processed in 23us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432912.845322:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787432912.845373:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609561216:0@lo:400:kworker.0 00010000:00080000:2.0:1787432912.845384:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94843f920700 x1874258609561088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432912.845393:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609561088:0@lo:400:kworker.0 00010000:00080000:2.0:1787432912.845412:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94843f920e00 x1874258609561600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432912.845432:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609561600:0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.845466:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609560704:0@lo:400:kworker.0 00010000:00080000:2.0:1787432912.845477:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94843f923b80 x1874258609561472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432912.845485:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609561472:0@lo:400:kworker.0 00000100:00100000:2.0:1787432912.845491:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a13c04c-dd5b-4f06-b031-814868f35d81:3643:1874258609560576:0@lo:400:kworker.0 00010000:00080000:2.0:1787432912.845499:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94843f921180 x1874258609561344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432912.845506:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609561344:0@lo:400:kworker.0 00000100:00100000:1.0:1787432912.845683:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609560832:0@lo:8:kworker.0 00000100:00100000:1.0:1787432912.845722:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432912.845750:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609560960:0@lo:8:kworker.0 00000100:00100000:1.0:1787432912.845773:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432912.845809:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609560832 00000100:00100000:1.0:1787432912.845813:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609560832 00000100:00100000:1.0:1787432912.845828:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609560960 00000100:00100000:1.0:1787432912.845831:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609560960 00000100:00100000:1.0:1787432912.845840:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432912.845845:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874258609560832:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787432912.845883:0:24228:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 723 last 0 00000020:00000080:1.0:1787432912.845911:0:24228:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b3356407d5 00002000:00100000:1.0:1787432912.845925:0:24228:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff948301e42000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787432912.845929:0:24228:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787432912.845932:0:24228:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787432912.846093:0:24228:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787432912.846117:0:24228:0:(import.c:65:import_set_state_nolock()) ffff948301e47000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432912.846188:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1874258609560832:12345-0@lo:8:kworker.0 Request processed in 318us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432912.846196:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432912.846210:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432912.846215:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874258609560960:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787432912.846227:0:24228:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787432912.846254:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874258609560960:12345-0@lo:8:kworker.0 Request processed in 37us (480us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787432912.846259:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787432912.846289:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94843f920000 x1874258609560832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787432932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787432912.846302:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787432912.846310:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787432912.846316:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787432912.846318:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843f868000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787432912.846333:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787432912.846339:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609560832:0@lo:8:kworker.0 00000100:00080000:1.0:1787432912.846350:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948304f08000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432912.846355:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787432912.846358:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609560960:0@lo:8:kworker.0 00000004:00080000:1.0:1787432912.846407:0:22744:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:1.0:1787432912.846435:0:22744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22744:1874258609561856:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787432912.846460:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432912.846476:0:22744:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841174f000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432912.846489:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609561728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432912.846522:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432912.846554:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609561728 00000100:00100000:1.0:1787432912.846558:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609561728 00000100:00100000:1.0:1787432912.846600:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432912.846608:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874258609561728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432912.846624:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787432912.846658:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874258609561728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432912.846664:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787432912.846690:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9483039b5500 x1874258609561728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432912.846705:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609561728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432912.846722:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609561856 00000100:00100000:1.0:1787432912.846725:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609561856 00000100:00100000:1.0:1787432912.846741:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787432912.846746:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22744:x1874258609561856:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787432912.848153:0:24228:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787432912.848200:0:24228:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1787432912.848206:0:24228:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00000004:00080000:2.0:1787432912.849558:0:22743:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787432912.849654:0:22743:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723941488792ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787432912.849663:0:22743:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:3.0:1787432912.850064:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432912.850071:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432912.850075:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1787432912.856157:0:22699:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787432912.862309:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.862321:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0a639ee/0xca72b3b3356407dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.862342:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.862346:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.862353:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a639ee/0xca72b3b3356407dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.862380:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0a639ee/0xca72b3b3356407dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.862391:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0a639ee/0xca72b3b3356407dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.862398:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a639ee/0xca72b3b3356407dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.862426:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432912.862483:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432912.862493:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0a639ee/0xca72b3b3356407dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.862503:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302691000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.862508:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0a639ee/0xca72b3b3356407dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.862518:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0a639ee/0xca72b3b3356407dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.862538:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0a639ee/0xca72b3b3356407dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.862561:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0a639ee/0xca72b3b3356407dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.862591:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.862593:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.862595:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.865978:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.865991:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038759957/0xca72b3b3356407e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.866007:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.866013:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.866019:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038759957/0xca72b3b3356407e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.866034:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038759957/0xca72b3b3356407e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.866045:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038759957/0xca72b3b3356407e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.866073:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038759957/0xca72b3b3356407e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.866107:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432912.866123:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432912.866132:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038759957/0xca72b3b3356407e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.866143:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302691e00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.866148:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038759957/0xca72b3b3356407e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.866160:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038759957/0xca72b3b3356407e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.866200:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038759957/0xca72b3b3356407e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.866208:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038759957/0xca72b3b3356407e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.866232:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.866233:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.866235:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.866758:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.866767:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2251ab7/0xca72b3b3356407ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.866777:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.866781:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.866786:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2251ab7/0xca72b3b3356407ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.866797:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2251ab7/0xca72b3b3356407ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.866805:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2251ab7/0xca72b3b3356407ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.866812:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2251ab7/0xca72b3b3356407ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.866833:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432912.866885:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432912.866893:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2251ab7/0xca72b3b3356407ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.866911:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302690800 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.866915:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2251ab7/0xca72b3b3356407ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.866923:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2251ab7/0xca72b3b3356407ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.866934:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2251ab7/0xca72b3b3356407ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.866941:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2251ab7/0xca72b3b3356407ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.866956:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.866958:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.866959:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.867278:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.867286:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041d398b5/0xca72b3b3356407f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.867299:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.867303:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.867308:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041d398b5/0xca72b3b3356407f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.867318:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041d398b5/0xca72b3b3356407f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.867326:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041d398b5/0xca72b3b3356407f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.867333:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041d398b5/0xca72b3b3356407f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.867353:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432912.867558:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432912.867564:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041d398b5/0xca72b3b3356407f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.867572:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302691400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.867576:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041d398b5/0xca72b3b3356407f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.867584:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041d398b5/0xca72b3b3356407f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.867605:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041d398b5/0xca72b3b3356407f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.867612:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041d398b5/0xca72b3b3356407f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.867627:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.867629:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.867630:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.868310:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.868319:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356407f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.868331:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.868335:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.868340:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356407f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.868351:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356407f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.868370:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356407f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.868378:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356407f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.868468:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787432912.869075:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.869082:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b3356407ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.869092:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.869095:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.869187:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b3356407ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.869200:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b3356407ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.869208:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b3356407ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.869215:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b3356407ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.869466:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432912.869474:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356407f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.869481:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301eda200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432912.869486:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356407f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.869493:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356407f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.869516:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356407f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.869523:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356407f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.869543:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432912.869546:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b3356407ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.869553:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edbc00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432912.869556:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b3356407ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.869563:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b3356407ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.869572:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b3356407ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.869579:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432912.869580:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432912.869582:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432912.869615:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787432912.869620:0:24228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b3356407ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.869737:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.870430:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.870438:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640806 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.870449:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.870452:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.870457:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640806 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.870467:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640806 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.870475:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640806 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.870482:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.870502:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432912.870542:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432912.870550:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.870574:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edb800 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432912.870579:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.870589:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640806 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.870603:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640806 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.870612:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640806 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.870628:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432912.870630:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432912.870631:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.870940:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.870948:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b33564080d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.870962:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.870965:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.870969:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b33564080d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.870978:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b33564080d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.870985:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b33564080d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.870991:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b33564080d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.871060:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787432912.871441:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.871447:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b335640814 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.871455:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.871458:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.871462:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b335640814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.871471:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b335640814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.871490:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b335640814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.871496:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b335640814 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.871553:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432912.871559:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b33564080d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.871568:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edb200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.871572:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b33564080d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.871581:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b33564080d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.871593:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b33564080d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.871600:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b33564080d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.871626:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432912.871629:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b335640814 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.871635:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edaa00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.871639:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b335640814 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.871646:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b335640814 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.871656:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b335640814 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.871663:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.871665:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.871667:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432912.871740:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787432912.871746:0:24228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b335640814 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787432912.872367:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.872374:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b33564081b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.872383:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.872386:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.872391:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b33564081b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.872400:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b33564081b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.872408:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b33564081b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.872438:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b33564081b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.872485:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432912.872491:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b33564081b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.872499:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edba00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.872503:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b33564081b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.872520:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b33564081b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.872531:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b33564081b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.872539:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.872541:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.872542:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432912.874394:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787432912.874406:0:24228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b33564081b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.874451:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.875287:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.875297:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b335640822 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.875311:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.875316:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.875322:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b335640822 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.875335:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b335640822 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.875344:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b335640822 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.875351:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b335640822 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.875425:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787432912.875793:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787432912.875813:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b92b1d69/0xca72b3b335640829 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.875824:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1787432912.875827:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432912.875832:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b92b1d69/0xca72b3b335640829 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.875843:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b92b1d69/0xca72b3b335640829 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.875857:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b92b1d69/0xca72b3b335640829 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.875865:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b92b1d69/0xca72b3b335640829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.875967:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432912.875975:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b335640822 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.875998:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edac00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.876004:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b335640822 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.876014:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b335640822 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.876014:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432912.876035:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b335640822 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.876043:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b335640822 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.876079:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432912.876083:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b92b1d69/0xca72b3b335640829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.876090:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f05000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.876094:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b92b1d69/0xca72b3b335640829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.876344:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.876389:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b92b1d69/0xca72b3b335640829 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.876401:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b92b1d69/0xca72b3b335640829 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.876408:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b92b1d69/0xca72b3b335640829 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.876432:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.876434:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.876436:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787432912.876642:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787432912.876649:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b37b4365/0xca72b3b335640830 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.876658:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=723s v=(0 0) 00010000:00010000:2.0:1787432912.876662:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432912.876666:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b37b4365/0xca72b3b335640830 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.876675:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b37b4365/0xca72b3b335640830 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.876683:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b37b4365/0xca72b3b335640830 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.876690:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b37b4365/0xca72b3b335640830 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432912.876731:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432912.877582:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432912.877592:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b37b4365/0xca72b3b335640830 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.877603:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f04200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432912.877608:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b37b4365/0xca72b3b335640830 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.877616:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b37b4365/0xca72b3b335640830 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.877630:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b37b4365/0xca72b3b335640830 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.877637:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b37b4365/0xca72b3b335640830 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.877655:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432912.877657:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432912.877659:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.881177:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.881195:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b335640837 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.881227:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.881232:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.881239:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b335640837 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.881254:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b335640837 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.881266:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b335640837 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.881274:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b335640837 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.881300:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432912.881325:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432912.881334:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b335640837 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.881344:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edba00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.881355:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b335640837 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.881366:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b335640837 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.881384:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b335640837 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.881392:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005afcd00a/0xca72b3b335640837 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.881410:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.881412:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.881414:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.882030:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.882037:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b33564083e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.882048:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.882051:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.882055:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b33564083e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.882064:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b33564083e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.882083:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b33564083e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.882091:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b33564083e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.882114:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432912.882244:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432912.882251:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b33564083e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.882260:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edaa00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.882265:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b33564083e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.882274:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b33564083e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.882287:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b33564083e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.882302:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064559ad0/0xca72b3b33564083e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.882319:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.882321:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.882323:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.882661:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.882668:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b335640845 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.882677:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.882680:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.882685:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b335640845 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.882693:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b335640845 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.882701:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b335640845 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.882721:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b335640845 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.882761:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432912.882950:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432912.882956:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b335640845 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.882964:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edbc00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.882967:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b335640845 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.882974:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b335640845 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.882986:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b335640845 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.882993:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076382c24/0xca72b3b335640845 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.883006:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.883008:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.883010:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.883903:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.883912:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a9ff3ea/0xca72b3b33564084c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.883924:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.883928:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.883933:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a9ff3ea/0xca72b3b33564084c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.883943:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a9ff3ea/0xca72b3b33564084c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.883951:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a9ff3ea/0xca72b3b33564084c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.883958:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a9ff3ea/0xca72b3b33564084c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.883981:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432912.884194:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432912.884201:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a9ff3ea/0xca72b3b33564084c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.884209:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301eda000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.884214:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a9ff3ea/0xca72b3b33564084c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.884221:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a9ff3ea/0xca72b3b33564084c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.884234:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a9ff3ea/0xca72b3b33564084c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.884240:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a9ff3ea/0xca72b3b33564084c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.884256:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.884258:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.884259:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.884910:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.884917:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000909d677e/0xca72b3b335640853 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.884927:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.884937:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.884943:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000909d677e/0xca72b3b335640853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.884954:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000909d677e/0xca72b3b335640853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.884963:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000909d677e/0xca72b3b335640853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.884975:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000909d677e/0xca72b3b335640853 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.884997:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787432912.886071:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.886081:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ed337f/0xca72b3b33564085a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.886094:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.886110:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.886341:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ed337f/0xca72b3b33564085a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.886356:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ed337f/0xca72b3b33564085a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.886366:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ed337f/0xca72b3b33564085a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.886387:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ed337f/0xca72b3b33564085a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.886411:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787432912.887682:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.887691:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008625913f/0xca72b3b335640861 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.887705:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.887719:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.887724:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008625913f/0xca72b3b335640861 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.887736:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008625913f/0xca72b3b335640861 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.887746:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008625913f/0xca72b3b335640861 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.887753:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008625913f/0xca72b3b335640861 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.887763:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787432912.887999:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787432912.888008:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000909d677e/0xca72b3b335640853 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888018:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edb000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.888022:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000909d677e/0xca72b3b335640853 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888044:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000909d677e/0xca72b3b335640853 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888062:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000909d677e/0xca72b3b335640853 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888070:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000909d677e/0xca72b3b335640853 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888091:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432912.888095:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ed337f/0xca72b3b33564085a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888102:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edb600 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.888105:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ed337f/0xca72b3b33564085a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888112:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ed337f/0xca72b3b33564085a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888122:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ed337f/0xca72b3b33564085a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888129:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ed337f/0xca72b3b33564085a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888152:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432912.888156:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008625913f/0xca72b3b335640861 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888161:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301eda800 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.888181:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008625913f/0xca72b3b335640861 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888188:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008625913f/0xca72b3b335640861 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888197:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008625913f/0xca72b3b335640861 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888203:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008625913f/0xca72b3b335640861 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888214:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.888216:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.888218:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.888225:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.888351:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.888357:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c2d050d/0xca72b3b335640868 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.888371:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.888374:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.888378:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c2d050d/0xca72b3b335640868 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.888388:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c2d050d/0xca72b3b335640868 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.888396:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c2d050d/0xca72b3b335640868 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.888403:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c2d050d/0xca72b3b335640868 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.888454:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432912.888490:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432912.888497:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c2d050d/0xca72b3b335640868 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888505:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301eda400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.888516:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c2d050d/0xca72b3b335640868 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888523:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c2d050d/0xca72b3b335640868 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888534:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c2d050d/0xca72b3b335640868 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888540:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c2d050d/0xca72b3b335640868 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.888553:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.888556:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.888558:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.889090:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.889112:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd80fa1e/0xca72b3b33564086f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.889129:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.889133:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.889144:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd80fa1e/0xca72b3b33564086f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.889154:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd80fa1e/0xca72b3b33564086f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.889208:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd80fa1e/0xca72b3b33564086f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.889216:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd80fa1e/0xca72b3b33564086f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.889239:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432912.889636:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432912.889643:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd80fa1e/0xca72b3b33564086f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.889652:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edbe00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432912.889656:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd80fa1e/0xca72b3b33564086f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.889664:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd80fa1e/0xca72b3b33564086f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.889677:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd80fa1e/0xca72b3b33564086f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.889691:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd80fa1e/0xca72b3b33564086f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.889705:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.889707:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432912.889708:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.890811:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.890824:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6f41d6/0xca72b3b335640876 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.890837:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.890841:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.890846:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6f41d6/0xca72b3b335640876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.890856:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb6f41d6/0xca72b3b335640876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.890865:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6f41d6/0xca72b3b335640876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.890871:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6f41d6/0xca72b3b335640876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.890916:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787432912.891537:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.891545:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053d340f7/0xca72b3b33564087d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.891553:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.891556:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.891561:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053d340f7/0xca72b3b33564087d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.891570:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053d340f7/0xca72b3b33564087d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.891578:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053d340f7/0xca72b3b33564087d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.891585:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053d340f7/0xca72b3b33564087d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.891600:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787432912.891609:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432912.891615:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb6f41d6/0xca72b3b335640876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.891622:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edb400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432912.891633:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6f41d6/0xca72b3b335640876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.891640:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6f41d6/0xca72b3b335640876 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.891656:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb6f41d6/0xca72b3b335640876 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.891662:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb6f41d6/0xca72b3b335640876 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.891690:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432912.891694:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053d340f7/0xca72b3b33564087d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.891700:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edae00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432912.891703:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053d340f7/0xca72b3b33564087d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.891820:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053d340f7/0xca72b3b33564087d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.891831:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053d340f7/0xca72b3b33564087d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.891838:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053d340f7/0xca72b3b33564087d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.891859:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432912.891861:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432912.891863:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.892459:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.892466:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feee86ef/0xca72b3b335640884 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.892475:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.892479:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.892484:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feee86ef/0xca72b3b335640884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.892493:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feee86ef/0xca72b3b335640884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.892501:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feee86ef/0xca72b3b335640884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.892508:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feee86ef/0xca72b3b335640884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.892521:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432912.892528:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432912.892531:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feee86ef/0xca72b3b335640884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.892548:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301eda600 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432912.892552:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feee86ef/0xca72b3b335640884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.892560:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feee86ef/0xca72b3b335640884 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.892571:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feee86ef/0xca72b3b335640884 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.892578:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feee86ef/0xca72b3b335640884 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.892593:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432912.892595:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432912.892596:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.892968:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.892975:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b33564088b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.892984:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.892987:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.892991:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b33564088b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893064:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b33564088b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893080:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b33564088b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893087:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b33564088b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893223:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432912.893233:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432912.893237:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b33564088b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893243:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edac00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432912.893246:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b33564088b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893253:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b33564088b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893264:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b33564088b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893272:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b25b7c/0xca72b3b33564088b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893288:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432912.893294:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432912.893296:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.893813:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.893820:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b335640892 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893830:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.893833:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.893838:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b335640892 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893847:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b335640892 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893856:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b335640892 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893862:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b335640892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893877:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432912.893885:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432912.893888:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b335640892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893894:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edb200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432912.893897:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b335640892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893915:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b335640892 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893925:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b335640892 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893931:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962fbb1b/0xca72b3b335640892 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.893946:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432912.893947:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432912.893949:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432912.894091:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.894549:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.894556:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640899 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.894565:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.894568:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.894572:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.894582:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.894589:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.894601:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.894614:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787432912.895094:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.895229:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356408a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.895240:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.895243:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.895247:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356408a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.895257:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356408a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.895266:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356408a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.895273:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356408a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.895287:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787432912.895640:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432912.895648:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.895658:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edb800 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432912.895663:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.895671:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640899 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.895689:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640899 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.895696:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b49ca53/0xca72b3b335640899 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.895727:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432912.895731:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356408a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.895736:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301eda200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432912.895746:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356408a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.895753:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356408a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.895763:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356408a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.895770:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000333f7a37/0xca72b3b3356408a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.895783:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432912.895785:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432912.895787:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432912.895794:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.895892:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.895899:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb72e0e3/0xca72b3b3356408a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.895913:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.895917:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.895921:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb72e0e3/0xca72b3b3356408a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.895930:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb72e0e3/0xca72b3b3356408a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.895939:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb72e0e3/0xca72b3b3356408a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.895946:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb72e0e3/0xca72b3b3356408a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.895966:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432912.895975:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432912.895981:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb72e0e3/0xca72b3b3356408a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.895987:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774600 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432912.895992:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb72e0e3/0xca72b3b3356408a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.895999:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb72e0e3/0xca72b3b3356408a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.896009:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb72e0e3/0xca72b3b3356408a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.896023:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb72e0e3/0xca72b3b3356408a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.896037:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432912.896038:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432912.896040:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.896475:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.896481:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d906434d/0xca72b3b3356408ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.896489:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.896492:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.896496:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d906434d/0xca72b3b3356408ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.896503:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d906434d/0xca72b3b3356408ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.896520:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d906434d/0xca72b3b3356408ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.896525:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d906434d/0xca72b3b3356408ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.896545:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432912.896928:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432912.896934:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d906434d/0xca72b3b3356408ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.896942:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432912.896946:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d906434d/0xca72b3b3356408ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.896954:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d906434d/0xca72b3b3356408ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.896967:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d906434d/0xca72b3b3356408ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.896973:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d906434d/0xca72b3b3356408ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.896991:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432912.896993:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432912.896995:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432912.897066:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432912.897074:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3d92fdc/0xca72b3b3356408b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.897082:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1787432912.897085:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432912.897090:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3d92fdc/0xca72b3b3356408b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.897111:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3d92fdc/0xca72b3b3356408b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.897127:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3d92fdc/0xca72b3b3356408b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.897135:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3d92fdc/0xca72b3b3356408b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432912.897183:0:24228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787432912.897473:0:24228:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1787432912.897557:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22744:x1874258609561856:12345-0@lo:5:osp-pre-0-0.0 Request processed in 50806us (51092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432912.897566:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787432912.897618:0:22744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22744:1874258609561856:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787432912.897633:0:22744:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1787432912.898585:0:22744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22744:1874258609561984:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787432912.898638:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432912.898671:0:22744:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841174f000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432912.898696:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609561984 00000100:00100000:1.0:1787432912.898702:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609561984 00000100:00100000:1.0:1787432912.898946:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787432912.898956:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22744:x1874258609561984:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787432912.899359:0:24225:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:0.0:1787432912.901540:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432912.901554:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3d92fdc/0xca72b3b3356408b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.901568:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775c00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432912.901573:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3d92fdc/0xca72b3b3356408b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.901585:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3d92fdc/0xca72b3b3356408b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.901609:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3d92fdc/0xca72b3b3356408b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.901617:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3d92fdc/0xca72b3b3356408b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432912.901642:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432912.901645:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432912.901647:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787432912.907596:0:24222:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1787432912.907647:0:24222:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787432912.907948:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22744:x1874258609561984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8985us (9301us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1787432912.907960:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787432912.908094:0:22744:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1787432912.908234:0:22744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22744:1874258609561984:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787432912.908253:0:22744:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:2.0:1787432913.036728:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432913.803049:0:24592:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787432914.068040:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787432914.508308:0:22754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1787432914.951901:0:24644:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432914.953062:0:24644:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787432915.087695:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787432915.856487:0:24694:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787432915.856711:0:24694:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787432915.915340:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432915.915376:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609562112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432915.915449:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432915.915501:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609562112 00000100:00100000:0.0:1787432915.915509:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609562112 00000100:00100000:0.0:1787432915.915554:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787432915.915563:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609562112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432915.915594:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787432915.915646:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609562112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432915.915653:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787432915.915699:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609562112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432915.915950:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432915.915960:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609562240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432915.915992:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432915.916189:0:23798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609562240 00000100:00100000:0.0:1787432915.916194:0:23798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609562240 00000100:00100000:0.0:1787432915.916217:0:23798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787432915.916223:0:23798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609562240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432915.916243:0:23798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787432915.916280:0:23798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609562240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432915.916286:0:23798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787432915.916355:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609562240:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787432916.107395:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787432917.004830:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787432917.131430:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787432917.963397:0:21347:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432917.963404:0:21347:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787432917.963407:0:21347:0:(import.c:65:import_set_state_nolock()) ffff948304f08000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432917.963415:0:21347:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 723 00000100:00100000:3.0:1787432917.963418:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609562624:0@lo:400:kworker.0 00000100:00080000:2.0:1787432917.963419:0:21347:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787432917.963425:0:21347:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948304f08000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432917.963456:0:21347:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303a3b480 x1874258609562752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432917.963489:0:21347:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1787432917.963490:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787432917.963493:0:21347:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432917.963495:0:21347:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432917.963499:0:21347:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787432917.963544:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609563264:0@lo:400:kworker.0 00000100:00100000:3.0:1787432917.963568:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432917.963585:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787432917.963590:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609562880:0@lo:400:kworker.0 00000100:00100000:3.0:1787432917.963607:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432917.963621:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609563392:0@lo:400:kworker.0 00000100:00100000:3.0:1787432917.963639:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432917.963647:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a13c04c-dd5b-4f06-b031-814868f35d81:3641:1874258609562368:0@lo:400:kworker.0 00000100:00100000:2.0:1787432917.963680:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432917.963682:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609562624 00000100:00100000:3.0:1787432917.963689:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609562624 00000100:00100000:2.0:1787432917.963703:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609563008:0@lo:400:kworker.0 00000100:00100000:2.0:1787432917.963725:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432917.963741:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432917.963751:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840356a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609562624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432917.969210:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609562752:0@lo:8:kworker.0 00000100:00100000:2.0:1787432917.969346:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609563520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432917.969459:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840356a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609562624:12345-0@lo:400:kworker.0 Request processed in 5707us (5966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432917.969471:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432917.969521:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609563264 00000100:00100000:3.0:1787432917.969532:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609563264 00000100:00100000:3.0:1787432917.969687:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609562880 00000100:00100000:3.0:1787432917.969691:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609562880 00000100:00100000:3.0:1787432917.969714:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609563392 00000100:00100000:3.0:1787432917.969718:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609563392 00000100:00100000:3.0:1787432917.969740:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787432917.969749:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609563264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432917.969796:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609563264:12345-0@lo:400:kworker.0 Request processed in 48us (6227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432917.969802:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787432917.969814:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787432917.969821:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609562880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432917.969856:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609562880:12345-0@lo:400:kworker.0 Request processed in 36us (6247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432917.969865:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787432917.969879:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787432917.969889:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840356ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609563392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432917.969994:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840356ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609563392:12345-0@lo:400:kworker.0 Request processed in 30us (6275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432917.970004:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1787432917.970032:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432917.970040:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432917.970043:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787432917.970140:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948303a39f80 x1874258609562880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432917.970161:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609562880:0@lo:400:kworker.0 00010000:00080000:3.0:1787432917.970191:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948303a3bb80 x1874258609563392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432917.970200:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609563392:0@lo:400:kworker.0 00010000:00080000:3.0:1787432917.970210:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948303a3ad80 x1874258609563264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432917.971928:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609563264:0@lo:400:kworker.0 00000100:00100000:3.0:1787432917.971958:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609562624:0@lo:400:kworker.0 00000100:00100000:3.0:1787432917.973200:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609562496:0@lo:400:kworker.0 00000100:00100000:3.0:1787432917.973280:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432917.973330:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609563136:0@lo:400:kworker.0 00000100:00100000:3.0:1787432917.973358:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432917.973400:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609563136 00000100:00100000:3.0:1787432917.973407:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609563136 00000100:00100000:3.0:1787432917.973452:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787432917.973462:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609563136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432917.973521:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609563136:12345-0@lo:400:kworker.0 Request processed in 58us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432917.973529:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787432917.973569:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948303a39180 x1874258609563136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432917.973580:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609563136:0@lo:400:kworker.0 00000100:00100000:0.0:1787432917.977710:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432917.977817:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609562368 00000100:00100000:0.0:1787432917.977828:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609562368 00000100:00100000:3.0:1787432917.977874:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609562752 00000100:00100000:3.0:1787432917.977880:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609562752 00000100:00100000:0.0:1787432917.977884:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787432917.977897:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+21:3641:x1874258609562368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432917.977912:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432917.977918:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1874258609562752:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787432917.977938:0:24225:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787432917.977956:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+21:3641:x1874258609562368:12345-0@lo:400:kworker.0 Request processed in 62us (14275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432917.977965:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787432917.978008:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609563008 00000100:00100000:0.0:1787432917.978014:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609563008 00000100:00100000:0.0:1787432917.978038:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609562496 00000100:00100000:0.0:1787432917.978041:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609562496 00000100:00100000:0.0:1787432917.978055:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787432917.978061:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609563008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432917.978107:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609563008:12345-0@lo:400:kworker.0 Request processed in 45us (14380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432917.978114:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787432917.978128:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787432917.978134:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840356b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609562496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432917.978197:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840356b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609562496:12345-0@lo:400:kworker.0 Request processed in 63us (4929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432917.978203:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787432917.978760:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432917.978818:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a13c04c-dd5b-4f06-b031-814868f35d81:3641:1874258609562368:0@lo:400:kworker.0 00000100:00100000:2.0:1787432917.978834:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609563008:0@lo:400:kworker.0 00000100:00100000:0.0:1787432917.978917:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609563520 00000100:00100000:0.0:1787432917.978922:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609563520 00000100:00100000:0.0:1787432917.978962:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432917.978970:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609563520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432917.978994:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787432917.979039:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609563520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432917.979045:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432917.979079:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609563520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432917.994356:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609562496:0@lo:400:kworker.0 00000100:00100000:3.0:1787432918.024104:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1874258609562752:12345-0@lo:8:kworker.0 Request processed in 46177us (46395us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787432918.024118:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787432918.035756:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948304f08000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787432918.035772:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787432918.035777:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609562752:0@lo:8:kworker.0 00010000:00010000:1.0:1787432918.158036:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432919.179337:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432920.013248:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432905/real 1787432905] req@ffff94842726c700 x1874258609555456/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432920 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432920.013286:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94842726c700 x1874258609555456/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432920 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432920.013297:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432905/real 1787432905] req@ffff94842726df80 x1874258609555584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432920 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432920.013310:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94842726df80 x1874258609555584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432920 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787432920.013340:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948434880800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432920.013359:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787432920.013364:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609555456:0@lo:8:kworker.0 00000100:00080000:0.0:1787432920.013369:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432920.013375:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787432920.013378:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609555584:0@lo:8:kworker.0 00000100:00100000:0.0:1787432920.013553:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1787432920.013800:0:21347:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432920.013804:0:21347:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787432920.013808:0:21347:0:(import.c:65:import_set_state_nolock()) ffff948304f08000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432920.013813:0:21347:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 729 00000100:00080000:3.0:1787432920.013818:0:21347:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787432920.013824:0:21347:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948304f08000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432920.013848:0:21347:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948403568a80 x1874258609564032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432920.013902:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609564160:0@lo:400:kworker.0 00000100:00100000:0.0:1787432920.013999:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432920.014036:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a13c04c-dd5b-4f06-b031-814868f35d81:3641:1874258609563648:0@lo:400:kworker.0 00000100:00100000:0.0:1787432920.014066:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432920.014110:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609564032:0@lo:8:kworker.0 00000100:00100000:0.0:1787432920.014137:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432920.014200:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609564160 00000100:00100000:0.0:1787432920.014208:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609564160 00000100:00100000:0.0:1787432920.014257:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787432920.014268:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609564160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432920.014333:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609564160:12345-0@lo:400:kworker.0 Request processed in 66us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432920.014341:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787432920.014369:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609563648 00000100:00100000:0.0:1787432920.014373:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609563648 00000100:00100000:0.0:1787432920.014398:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787432920.014405:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+21:3641:x1874258609563648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432920.014447:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+21:3641:x1874258609563648:12345-0@lo:400:kworker.0 Request processed in 43us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432920.014453:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787432920.014482:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609564032 00000100:00100000:0.0:1787432920.014486:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609564032 00000100:00080000:3.0:1787432920.014672:0:21347:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432920.014676:0:21347:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787432920.014679:0:21347:0:(import.c:65:import_set_state_nolock()) ffff948434880800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432920.014683:0:21347:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 716 00000100:00080000:3.0:1787432920.014686:0:21347:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787432920.014690:0:21347:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff948434880800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432920.014705:0:21347:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94830456a300 x1874258609564416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432920.014719:0:21347:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432920.014729:0:21347:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787432920.014731:0:21347:0:(import.c:65:import_set_state_nolock()) ffff94843c7f0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432920.014735:0:21347:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 716 00000100:00080000:3.0:1787432920.014737:0:21347:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787432920.014741:0:21347:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94843c7f0000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432920.014756:0:21347:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948304569c00 x1874258609564544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432920.014801:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609563904:0@lo:400:kworker.0 00000100:00100000:3.0:1787432920.014834:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432920.015122:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609563776:0@lo:400:kworker.0 00000100:00100000:1.0:1787432920.015160:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432920.015202:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609564672:0@lo:400:kworker.0 00000100:00100000:1.0:1787432920.015230:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432920.015382:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609564800:0@lo:400:kworker.0 00000100:00100000:3.0:1787432920.015406:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432920.015436:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609564672 00000100:00100000:3.0:1787432920.015440:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609564672 00000100:00100000:3.0:1787432920.015466:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609564800 00000100:00100000:3.0:1787432920.015469:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609564800 00000100:00100000:3.0:1787432920.015493:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787432920.015500:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609564672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432920.015538:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609564672:12345-0@lo:400:kworker.0 Request processed in 39us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432920.015544:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787432920.015559:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787432920.015565:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609564800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432920.015612:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609564800:12345-0@lo:400:kworker.0 Request processed in 46us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432920.015618:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787432920.015639:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787432920.015672:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94830456b800 x1874258609564672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432920.015685:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609564672:0@lo:400:kworker.0 00000100:00100000:3.0:1787432920.015707:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609564288:0@lo:400:kworker.0 00000100:00100000:3.0:1787432920.015731:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432920.015755:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432920.015760:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609564928:0@lo:400:kworker.0 00000100:00100000:3.0:1787432920.015781:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432920.015800:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609564928 00000100:00100000:3.0:1787432920.015804:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609564928 00000100:00100000:3.0:1787432920.015833:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787432920.015840:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609564928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432920.015871:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609564928:12345-0@lo:400:kworker.0 Request processed in 32us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432920.015877:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787432920.015891:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787432920.015907:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948304568a80 x1874258609564928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432920.015916:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609564928:0@lo:400:kworker.0 00010000:00080000:3.0:1787432920.015936:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94830456bb80 x1874258609564800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432920.016156:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609564800:0@lo:400:kworker.0 00000100:00100000:0.0:1787432920.016227:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609563904 00000100:00100000:0.0:1787432920.016231:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609563904 00000100:00100000:0.0:1787432920.016360:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432920.016369:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609563904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432920.016413:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609563904:12345-0@lo:400:kworker.0 Request processed in 46us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432920.016419:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432920.016433:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787432920.016439:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874258609564032:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787432920.016458:0:24228:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787432920.016487:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874258609564032:12345-0@lo:8:kworker.0 Request processed in 47us (2349us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787432920.016493:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787432920.016531:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94840356a680 x1874258609564160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432920.016541:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609564160:0@lo:400:kworker.0 00000100:00100000:0.0:1787432920.016552:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a13c04c-dd5b-4f06-b031-814868f35d81:3641:1874258609563648:0@lo:400:kworker.0 00000100:00100000:0.0:1787432920.016580:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609564416:0@lo:8:kworker.0 00000100:00100000:0.0:1787432920.016609:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432920.016646:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609564544:0@lo:8:kworker.0 00000100:00100000:0.0:1787432920.016668:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787432920.016687:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948304f08000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432920.016691:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787432920.016694:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609564032:0@lo:8:kworker.0 00000100:00100000:0.0:1787432920.016718:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609563776 00000100:00100000:0.0:1787432920.016722:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609563776 00000100:00100000:0.0:1787432920.016745:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609564288 00000100:00100000:0.0:1787432920.016748:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609564288 00000100:00100000:0.0:1787432920.016762:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787432920.016768:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609563776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432920.016806:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609563776:12345-0@lo:400:kworker.0 Request processed in 38us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432920.016812:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787432920.016824:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787432920.016830:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609564288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432920.016862:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609564288:12345-0@lo:400:kworker.0 Request processed in 32us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432920.016868:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787432920.016905:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609563776:0@lo:400:kworker.0 00000100:00100000:0.0:1787432920.016927:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609564288:0@lo:400:kworker.0 00000100:00100000:0.0:1787432920.017492:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609563904:0@lo:400:kworker.0 00000100:00100000:0.0:1787432920.017513:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609564416 00000100:00100000:0.0:1787432920.017517:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609564416 00000100:00100000:0.0:1787432920.017531:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609564544 00000100:00100000:0.0:1787432920.017543:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609564544 00000100:00100000:0.0:1787432920.017557:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787432920.017562:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874258609564416:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787432920.017582:0:24228:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 731 last 0 00000020:00000080:0.0:1787432920.017610:0:24228:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b3356408bc 00002000:00100000:0.0:1787432920.017625:0:24228:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9483032eb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787432920.017629:0:24228:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1787432920.017632:0:24228:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787432920.017726:0:24228:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787432920.017749:0:24228:0:(import.c:65:import_set_state_nolock()) ffff9483032e9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432920.017795:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1874258609564416:12345-0@lo:8:kworker.0 Request processed in 232us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432920.017802:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787432920.017815:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432920.017819:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874258609564544:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787432920.017831:0:24228:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787432920.017858:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874258609564544:12345-0@lo:8:kworker.0 Request processed in 36us (1188us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787432920.017864:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432920.017890:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787432920.017899:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787432920.017907:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787432920.017913:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787432920.017916:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948434880800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787432920.017932:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000004:00080000:1.0:1787432920.018256:0:23462:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787432920.018291:0:23462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434898000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23462:1874258609565184:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787432920.018327:0:23462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432920.018350:0:23462:0:(client.c:2715:ptlrpc_set_wait()) set ffff948435bf1540 going to sleep for 11 seconds 00000100:00100000:2.0:1787432920.018405:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609565184 00000100:00100000:2.0:1787432920.018409:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609565184 00000100:00100000:0.0:1787432920.018453:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609564416:0@lo:8:kworker.0 00000100:00080000:0.0:1787432920.018479:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432920.018483:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787432920.018486:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609564544:0@lo:8:kworker.0 00000004:00080000:0.0:1787432920.018513:0:23461:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787432920.018588:0:23461:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 731110422743ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787432920.018594:0:23461:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787432920.018626:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432920.018635:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609565056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432920.018662:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432920.018690:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609565056 00000100:00100000:0.0:1787432920.018693:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609565056 00000100:00100000:0.0:1787432920.018724:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432920.018731:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1874258609565056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432920.018749:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787432920.018785:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1874258609565056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432920.018791:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432920.018824:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609565056:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787432920.022288:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787432920.028912:0:23453:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787432920.029306:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432920.029321:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23462:x1874258609565184:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:3.0:1787432920.042742:0:24227:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787432920.042753:0:24227:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787432920.042864:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23462:x1874258609565184:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13544us (24532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432920.042875:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432920.044826:0:23462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434898000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23462:1874258609565184:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1787432920.044844:0:23462:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787432920.044889:0:23462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23462:1874258609565312:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787432920.044958:0:23462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432920.044995:0:23462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432920.046591:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609565312 00000100:00100000:3.0:1787432920.046607:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609565312 00000100:00100000:3.0:1787432920.046673:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787432920.046685:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23462:x1874258609565312:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787432920.046720:0:24228:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1787432920.046798:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23462:x1874258609565312:12345-0@lo:5:osp-pre-0-1.0 Request processed in 115us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432920.046806:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432920.047076:0:23462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23462:1874258609565312:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787432920.047091:0:23462:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787432920.047129:0:23462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23462:1874258609565440:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787432920.047193:0:23462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432920.047217:0:23462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432920.047705:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609565440 00000100:00100000:3.0:1787432920.047712:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609565440 00000100:00100000:3.0:1787432920.047754:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787432920.047763:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23462:x1874258609565440:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787432920.047792:0:24227:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:3.0:1787432920.076959:0:24222:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1787432920.076982:0:24222:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787432920.092403:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23462:x1874258609565440:12345-0@lo:5:osp-pre-0-1.0 Request processed in 44630us (45228us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787432920.092424:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432920.107902:0:23462:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1787432920.107921:0:23462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23462:1874258609565440:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787432920.107938:0:23462:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1787432920.107997:0:23462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23462:1874258609565568:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787432920.108077:0:23462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432920.108112:0:23462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432920.108747:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609565568 00000100:00100000:0.0:1787432920.108754:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609565568 00000100:00100000:0.0:1787432920.108813:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432920.108823:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23462:x1874258609565568:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787432920.108890:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23462:x1874258609565568:12345-0@lo:900:osp-pre-0-1.0 Request processed in 68us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432920.108897:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787432920.108934:0:23462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948303a3b480 x1874258609565568/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787432936 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432920.108970:0:23462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23462:1874258609565568:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1787432920.205680:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432921.039597:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609565696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432921.039675:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432921.039735:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609565696 00000100:00100000:1.0:1787432921.039742:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609565696 00000100:00100000:1.0:1787432921.039788:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787432921.039796:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609565696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787432921.039828:0:22724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787432921.039869:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609565696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432921.039876:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787432921.039930:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609565696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432921.043492:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432921.043515:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609565824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432921.043593:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432921.043649:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609565824 00000100:00100000:0.0:1787432921.043657:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609565824 00000100:00100000:0.0:1787432921.043712:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787432921.043722:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609565824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432921.043756:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787432921.043801:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609565824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432921.043809:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787432921.044012:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609565824:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787432921.228885:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432922.255153:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787432922.703666:0:25039:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787432922.703670:0:25039:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787432922.703672:0:25039:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787432922.705010:0:25039:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9484166d5000 00000020:01000004:2.0:1787432922.705033:0:25039:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787432922.705050:0:25039:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787432922.705066:0:25039:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9483031a8000) 00000020:00000080:2.0:1787432922.705084:0:25039:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787432922.794549:0:25039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787432922.797603:0:25039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1787432922.798027:0:25039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787432922.798460:0:25039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787432922.798664:0:25039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787432922.799485:0:25039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787432922.799780:0:25039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1787432922.801686:0:25039:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787432922.801919:0:25039:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787432922.801934:0:25039:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787432922.801946:0:25039:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xca72b3b3356408ca 00000020:01000004:0.0:1787432922.801953:0:25039:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787432922.801983:0:25039:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.124@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787432922.801987:0:25039:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787432922.801993:0:25039:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787432922.802021:0:25039:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787432922.802026:0:25039:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.124@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787432922.816071:0:25039:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.124@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787432922.816119:0:25039:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.124@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787432922.816125:0:25039:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787432922.816127:0:25039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787432922.816128:0:25039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432922.816130:0:25039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432922.816131:0:25039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432922.816133:0:25039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432922.816134:0:25039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432922.816136:0:25039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432922.816137:0:25039:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787432922.816141:0:25039:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787432922.816143:0:25039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787432922.816145:0:25039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787432922.816146:0:25039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432922.816147:0:25039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432922.816148:0:25039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432922.816149:0:25039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432922.816151:0:25039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432922.816152:0:25039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432922.816153:0:25039:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787432922.816829:0:25039:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787432922.816850:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434898700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609565952:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787432922.816949:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432922.816993:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432922.818878:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609565952 00000100:00100000:0.0:1787432922.818892:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609565952 00000100:00100000:0.0:1787432922.818956:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787432922.818966:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+21:25039:x1874258609565952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787432922.819002:0:22714:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787432922.819006:0:22714:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787432922.819010:0:22714:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787432922.819749:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+21:25039:x1874258609565952:12345-0@lo:253:mount.lustre.0 Request processed in 781us (2796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432922.819760:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787432922.819879:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434898700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609565952:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787432922.819901:0:25039:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787432922.819905:0:25039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787432922.819906:0:25039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787432922.819908:0:25039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432922.819909:0:25039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432922.819910:0:25039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432922.819911:0:25039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432922.819933:0:25039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432922.819935:0:25039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432922.819936:0:25039:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787432922.819958:0:25039:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9484166d5000 from lustre-OST0001 10000000:01000000:1.0:1787432922.819986:0:25039:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787432922.819989:0:25039:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787432922.819997:0:25039:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94843b95cd28 local copy 00010000:00010000:1.0:1787432922.820006:0:25039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640504 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432922.820108:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434898700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432922.820143:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432922.820485:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609566080 00000100:00100000:0.0:1787432922.820492:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609566080 00000100:00100000:0.0:1787432922.820537:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787432922.820546:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+21:25039:x1874258609566080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432922.820610:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+21:25039:x1874258609566080:12345-0@lo:501:mount.lustre.0 Request processed in 66us (466us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787432922.820617:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787432922.820793:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432922.820811:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434898700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566080:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787432922.820827:0:25039:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787432922.820858:0:25039:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787432922.820865:0:25039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640504 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432922.820883:0:25039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948302690a00/0xca72b3b3356404fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640504 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432922.820948:0:25039:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9484166d5000 10000000:01000000:3.0:1787432922.820953:0:25039:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787432922.820959:0:25039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787432922.820961:0:25039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787432922.820965:0:25039:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787432922.820968:0:25039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787432922.820991:0:25039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b3356408d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432922.820999:0:25039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b3356408d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432922.821008:0:25039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b3356408d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432922.821024:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432922.821055:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432922.821078:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff948411a24f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432922.821261:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609566208 00000100:00100000:0.0:1787432922.821266:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609566208 00000100:00100000:0.0:1787432922.821299:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787432922.821307:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+21:25039:x1874258609566208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432922.821316:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432922.821328:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fd000/0xca72b3b3356408d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b3356408d1 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.821356:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fd000/0xca72b3b3356408d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b3356408d1 expref: 22 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.821367:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fd000/0xca72b3b3356408d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356408d1 expref: 22 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.821375:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fd000, rc 0) 00000100:00100000:0.0:1787432922.821415:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+22:25039:x1874258609566208:12345-0@lo:101:mount.lustre.0 Request processed in 109us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432922.821422:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787432922.822209:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432922.822240:0:25039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b3356408d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356408d8 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432922.822251:0:25039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b3356408d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b3356408d8 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787432922.823812:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1787432922.826462:0:25039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787432922.831939:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787432922.832000:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1787432922.832014:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1787432922.832027:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1787432922.832038:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1787432922.832048:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1787432922.832058:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1787432922.832069:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1787432922.832079:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1787432922.832101:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1787432922.832105:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1787432922.832288:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432922.832364:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432922.832412:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484126b6780 going to sleep for 11 seconds 00000100:00100000:1.0:1787432922.832614:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609566336 00000100:00100000:1.0:1787432922.832622:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609566336 00000100:00100000:1.0:1787432922.832680:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787432922.832689:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+22:25039:x1874258609566336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432922.832984:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+22:25039:x1874258609566336:12345-0@lo:501:mount.lustre.0 Request processed in 295us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432922.832992:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787432922.833544:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432922.833583:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432922.833630:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432922.833722:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609566464 00000100:00100000:1.0:1787432922.833726:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609566464 00000100:00100000:1.0:1787432922.833751:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787432922.833757:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+22:25039:x1874258609566464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432922.834320:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484126b6780 going to sleep for 11 seconds 00000100:00100000:1.0:1787432922.834710:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+22:25039:x1874258609566464:12345-0@lo:503:mount.lustre.0 Request processed in 949us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432922.834718:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787432922.834867:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566464:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787432922.835574:0:25039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787432922.835728:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432922.835788:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432922.835814:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9300 going to sleep for 11 seconds 00000100:00100000:1.0:1787432922.836109:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609566592 00000100:00100000:1.0:1787432922.836116:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609566592 00000100:00100000:1.0:1787432922.836184:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787432922.836201:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+22:25039:x1874258609566592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432922.836748:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+22:25039:x1874258609566592:12345-0@lo:502:mount.lustre.0 Request processed in 547us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432922.836757:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787432922.837077:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566592:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787432922.837521:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787432922.837553:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1787432922.837569:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1787432922.837584:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1787432922.837610:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1787432922.837624:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1787432922.837637:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1787432922.838481:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1787432922.838515:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1787432922.838564:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432922.838638:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432922.838689:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff948411a24f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432922.838787:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609566720 00000100:00100000:1.0:1787432922.838795:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609566720 00000100:00100000:1.0:1787432922.838852:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787432922.838862:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+22:25039:x1874258609566720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432922.839055:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+22:25039:x1874258609566720:12345-0@lo:502:mount.lustre.0 Request processed in 193us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432922.839063:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787432922.839689:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787432922.839760:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1787432922.839773:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1787432922.841126:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787432922.841138:0:25043:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787432922.841146:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432922.841148:0:25043:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787432922.841155:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787432922.841292:0:25043:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9484349d0000) 00000020:00000080:3.0:1787432922.841319:0:25043:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787432922.841327:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787432922.841406:0:25043:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9484166d5000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787432922.841414:0:25043:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787432922.841423:0:25043:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xca72b3b3356408e6 00010000:00010000:3.0:1787432922.848634:0:25043:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1787432922.849722:0:25043:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1787432922.852112:0:25043:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1787432922.864578:0:25043:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787432922.864592:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432922.864599:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432922.864601:0:25043:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787432922.864605:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432922.864623:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432922.864624:0:25043:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787432922.864631:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787432922.864634:0:25043:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787432922.864636:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432922.864638:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432922.864640:0:25043:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787432922.864642:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432922.864644:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432922.864645:0:25043:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787432922.864648:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787432922.864678:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432922.864681:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432922.864682:0:25043:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787432922.864685:0:25043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1787432922.866184:0:25039:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787432922.866236:0:25039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787432922.866266:0:25039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b3356408d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356408d8 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.866280:0:25039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b3356408d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356408d8 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432922.866288:0:25039:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9484166d5000 from 1 10000000:01000000:0.0:1787432922.866290:0:25039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787432922.866333:0:25039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fde00/0xca72b3b3356408ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.866340:0:25039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484013fde00/0xca72b3b3356408ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.866350:0:25039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484013fde00/0xca72b3b3356408ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432922.866391:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787432922.866460:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432922.866508:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303015600 going to sleep for 11 seconds 00000100:00100000:3.0:1787432922.866746:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609566848 00000100:00100000:3.0:1787432922.866755:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609566848 00000100:00100000:3.0:1787432922.866806:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787432922.866816:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+22:25039:x1874258609566848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432922.866828:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432922.866841:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94843f85e800/0xca72b3b3356408f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b3356408ed expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432922.866865:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94843f85e800/0xca72b3b3356408f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b3356408ed expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432922.866887:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94843f85e800/0xca72b3b3356408f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356408ed expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432922.866896:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e800, rc 0) 00000100:00100000:3.0:1787432922.867110:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+23:25039:x1874258609566848:12345-0@lo:101:mount.lustre.0 Request processed in 295us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432922.867128:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787432922.867253:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432922.867268:0:25039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484013fde00/0xca72b3b3356408ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356408f4 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.867277:0:25039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484013fde00/0xca72b3b3356408ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b3356408f4 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787432922.868669:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1787432922.869068:0:25039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432922.869329:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1787432922.869355:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1787432922.869368:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1787432922.869379:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1787432922.869391:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1787432922.869402:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1787432922.869413:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1787432922.869424:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1787432922.869450:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1787432922.869463:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1787432922.869476:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1787432922.869495:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1787432922.869500:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1787432922.869575:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432922.869640:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432922.869676:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1787432922.869860:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609566976 00000100:00100000:0.0:1787432922.869879:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609566976 00000100:00100000:0.0:1787432922.869939:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787432922.869950:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+23:25039:x1874258609566976:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432922.870069:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+23:25039:x1874258609566976:12345-0@lo:501:mount.lustre.0 Request processed in 121us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432922.870077:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787432922.873213:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609566976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432922.873291:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609567104:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432922.873371:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432922.873411:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037ea180 going to sleep for 11 seconds 00000100:00100000:3.0:1787432922.873494:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609567104 00000100:00100000:3.0:1787432922.873501:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609567104 00000100:00100000:3.0:1787432922.873545:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787432922.873555:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+23:25039:x1874258609567104:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432922.873672:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+23:25039:x1874258609567104:12345-0@lo:503:mount.lustre.0 Request processed in 117us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432922.873680:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787432922.873772:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609567104:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787432922.874611:0:25039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787432922.874702:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609567232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432922.874754:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432922.874790:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037ea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432922.876041:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609567232 00000100:00100000:0.0:1787432922.876057:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609567232 00000100:00100000:0.0:1787432922.876132:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787432922.876145:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+23:25039:x1874258609567232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432922.876346:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+23:25039:x1874258609567232:12345-0@lo:502:mount.lustre.0 Request processed in 203us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432922.876355:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787432922.877625:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609567232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787432922.877864:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787432922.878789:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1787432922.878810:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1787432922.878825:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1787432922.878837:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1787432922.878850:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1787432922.878863:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1787432922.878887:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1787432922.878905:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1787432922.878944:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1787432922.878959:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1787432922.879000:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609567360:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432922.879073:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432922.879111:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037ea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432922.879261:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609567360 00000100:00100000:0.0:1787432922.879268:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609567360 00000100:00100000:0.0:1787432922.879322:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787432922.879332:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+23:25039:x1874258609567360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432922.879451:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+23:25039:x1874258609567360:12345-0@lo:502:mount.lustre.0 Request processed in 120us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432922.879460:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787432922.882090:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609567360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432922.882214:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1787432922.882237:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787432922.895412:0:25047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432922.895441:0:25047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432922.895444:0:25047:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787432922.895451:0:25047:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9484166d5000 00000020:00000080:0.0:1787432922.895454:0:25047:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432922.895461:0:25047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432922.895464:0:25047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432922.895465:0:25047:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787432922.895468:0:25047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432922.895471:0:25047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432922.895472:0:25047:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787432922.895475:0:25047:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9484166d5000 00000020:00000080:0.0:1787432922.895477:0:25047:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432922.895544:0:25047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432922.895549:0:25047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432922.895550:0:25047:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787432922.895553:0:25047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432922.895555:0:25047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432922.895556:0:25047:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787432922.895560:0:25047:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9484166d5000 00000020:00000080:0.0:1787432922.895562:0:25047:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432922.895583:0:25047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432922.895586:0:25047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432922.895587:0:25047:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787432922.895590:0:25047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432922.895592:0:25047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432922.895593:0:25047:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787432922.895596:0:25047:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9484166d5000 00000020:00000080:0.0:1787432922.895598:0:25047:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432922.895620:0:25047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432922.895623:0:25047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432922.895625:0:25047:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787432922.895628:0:25047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1787432922.903083:0:25039:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787432922.903132:0:25039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787432922.903156:0:25039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fde00/0xca72b3b3356408ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356408f4 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432922.903184:0:25039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484013fde00/0xca72b3b3356408ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356408f4 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432922.903258:0:25039:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787432922.903262:0:25039:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9484166d5000 10000000:01000000:3.0:1787432922.903265:0:25039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9484166d5000 10000000:01000000:3.0:1787432922.903269:0:25039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787432922.903276:0:25039:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9484166d5000 from 1 10000000:01000000:3.0:1787432922.903279:0:25039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787432922.903320:0:25039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85fc00/0xca72b3b3356408fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432922.903329:0:25039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85fc00/0xca72b3b3356408fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432922.903340:0:25039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85fc00/0xca72b3b3356408fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432922.903373:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609567488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432922.903439:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432922.903486:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609567488 00000100:00100000:3.0:1787432922.903494:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609567488 00000100:00100000:3.0:1787432922.903540:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787432922.903549:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+23:25039:x1874258609567488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432922.903562:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432922.903577:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94843f85f400/0xca72b3b335640902 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b3356408fb expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432922.903601:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94843f85f400/0xca72b3b335640902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b3356408fb expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432922.903611:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94843f85f400/0xca72b3b335640902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356408fb expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432922.903619:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85f400, rc 0) 00000100:00100000:3.0:1787432922.903651:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+24:25039:x1874258609567488:12345-0@lo:101:mount.lustre.0 Request processed in 102us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432922.903658:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787432922.903705:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484099ba3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432922.903727:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609567488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432922.903740:0:25039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85fc00/0xca72b3b3356408fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640902 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432922.903748:0:25039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85fc00/0xca72b3b3356408fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640902 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787432922.906908:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1787432922.907253:0:25039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787432922.907441:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1787432922.907469:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1787432922.907486:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1787432922.907501:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1787432922.907514:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1787432922.907528:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1787432922.907543:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1787432922.907557:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1787432922.907571:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1787432922.907583:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1787432922.907612:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1787432922.907628:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1787432922.907639:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1787432922.907652:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1787432922.907664:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1787432922.907676:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1787432922.907690:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1787432922.907702:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1787432922.907712:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1787432922.907722:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1787432922.907735:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1787432922.907746:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1787432922.907758:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1787432922.907771:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1787432922.907782:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1787432922.907792:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1787432922.907816:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1787432922.907830:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1787432922.907841:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1787432922.907864:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1787432922.907878:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1787432922.907890:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1787432922.907902:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1787432922.907914:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1787432922.907926:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1787432922.907939:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1787432922.907952:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1787432922.907965:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1787432922.907978:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1787432922.907991:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1787432922.908004:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1787432922.908017:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1787432922.908046:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1787432922.908061:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1787432922.908073:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1787432922.908086:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1787432922.908100:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1787432922.908111:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1787432922.910276:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1787432922.910333:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1787432922.910360:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1787432922.910366:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1787432922.910482:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609567616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432922.910671:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432922.910717:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff948404f1f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787432922.911143:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609567616 00000100:00100000:2.0:1787432922.911151:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609567616 00000100:00100000:2.0:1787432922.911238:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787432922.911249:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:25039:x1874258609567616:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432922.911385:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:25039:x1874258609567616:12345-0@lo:501:mount.lustre.0 Request processed in 138us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432922.911393:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787432922.911915:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609567616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432922.912093:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609567744:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432922.912146:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432922.914229:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff948404f1f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787432922.914984:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609567744 00000100:00100000:2.0:1787432922.915003:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609567744 00000100:00100000:2.0:1787432922.915080:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787432922.915093:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+24:25039:x1874258609567744:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787432922.915289:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+24:25039:x1874258609567744:12345-0@lo:503:mount.lustre.0 Request processed in 198us (3141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432922.915296:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787432922.915531:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609567744:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787432922.916513:0:25039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787432922.916605:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609567872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432922.916678:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432922.916720:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff948404f1f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787432922.918365:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609567872 00000100:00100000:2.0:1787432922.918376:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609567872 00000100:00100000:2.0:1787432922.918432:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787432922.918443:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+24:25039:x1874258609567872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432922.918608:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+24:25039:x1874258609567872:12345-0@lo:502:mount.lustre.0 Request processed in 167us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432922.918616:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787432922.919438:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609567872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787432922.919663:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787432922.919694:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1787432922.919707:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1787432922.919722:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1787432922.919749:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1787432922.919760:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1787432922.919775:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1787432922.919786:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1787432922.919796:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787432922.919806:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1787432922.919817:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1787432922.919828:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1787432922.919838:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1787432922.919849:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1787432922.919859:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1787432922.919869:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1787432922.919896:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1787432922.919907:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1787432922.922620:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1787432922.922672:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1787432922.922710:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1787432922.922728:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1787432922.922741:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1787432922.922754:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1787432922.922778:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1787432922.922792:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1787432922.922805:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1787432922.922816:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1787432922.922828:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1787432922.922841:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1787432922.922855:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1787432922.922869:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1787432922.922899:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1787432922.922914:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1787432922.925181:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1787432922.925201:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1787432922.925243:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1787432922.925258:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1787432922.925270:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1787432922.925281:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1787432922.925293:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1787432922.925305:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1787432922.925317:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1787432922.925329:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1787432922.925342:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1787432922.925355:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1787432922.925367:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1787432922.925380:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1787432922.925433:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609568000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432922.925506:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432922.925540:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff948404f1f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787432922.925794:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609568000 00000100:00100000:2.0:1787432922.925803:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609568000 00000100:00100000:2.0:1787432922.925856:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787432922.925878:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:25039:x1874258609568000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432922.926020:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:25039:x1874258609568000:12345-0@lo:502:mount.lustre.0 Request processed in 155us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432922.926028:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787432922.927284:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609568000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787432922.929399:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1787432922.929450:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1787432922.930041:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609568128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432922.930124:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432922.932374:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff948404f1f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787432922.934055:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609568128 00000100:00100000:2.0:1787432922.934070:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609568128 00000100:00100000:2.0:1787432922.934134:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787432922.934146:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+24:25039:x1874258609568128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432922.934339:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+24:25039:x1874258609568128:12345-0@lo:502:mount.lustre.0 Request processed in 194us (4215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432922.934356:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787432922.934690:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609568128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432922.934783:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1787432922.934797:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787432922.938040:0:25052:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787432922.938064:0:25052:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9483031ab370) 00000020:00000080:2.0:1787432922.938099:0:25052:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1787432922.938243:0:25052:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9484166d5000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787432922.938248:0:25052:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9484166d5000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787432922.938251:0:25052:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9484166d5000 3 00010000:00080000:2.0:1787432922.938281:0:25052:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948301da9000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.124@tcp at head 00010000:00010000:2.0:1787432922.945340:0:25052:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1787432922.945641:0:25052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787432922.945687:0:25052:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787432922.945702:0:25052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xca72b3b335640910 00000100:00080000:2.0:1787432922.945713:0:25052:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787432922.945719:0:25052:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff948301da9000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432922.948857:0:25052:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303a38000 x1874258609568256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432922.948906:0:25052:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:3.0:1787432922.949461:0:25052:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787432922.949491:0:25052:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9484349d4d28) 00000020:00000080:3.0:1787432922.949515:0:25052:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1787432922.949598:0:25052:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9484166d5000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787432922.949602:0:25052:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9484166d5000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787432922.949604:0:25052:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9484166d5000 3 00010000:00080000:3.0:1787432922.949655:0:25052:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948302521800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.124@tcp at head 00010000:00010000:3.0:1787432922.951369:0:25052:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:0.0:1787432922.951639:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609568256:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787432922.951735:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787432922.951885:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432922.951889:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787432922.951892:0:8:0:(import.c:65:import_set_state_nolock()) ffff948304f08000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432922.951897:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 731 00000100:00080000:0.0:1787432922.951901:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787432922.951907:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948304f08000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432922.951927:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94842726f100 x1874258609568640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432922.952000:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432922.952004:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787432922.952006:0:8:0:(import.c:65:import_set_state_nolock()) ffff94843c7f0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432922.952010:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 731 00000100:00080000:0.0:1787432922.952014:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787432922.952018:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94843c7f0000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432922.952032:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94842726ce00 x1874258609569152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432922.952071:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609568384:0@lo:400:kworker.0 00000100:00100000:0.0:1787432922.952103:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432922.952130:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609569024:0@lo:400:kworker.0 00000100:00100000:0.0:1787432922.952155:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432922.952196:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787432922.952203:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609568512:0@lo:400:kworker.0 00000100:00100000:0.0:1787432922.952237:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432922.952264:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609569280:0@lo:400:kworker.0 00000100:00100000:0.0:1787432922.952297:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432922.952366:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609568896:0@lo:400:kworker.0 00000100:00100000:3.0:1787432922.952396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432922.952415:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609569536:0@lo:400:kworker.0 00000100:00100000:3.0:1787432922.952445:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609569024 00000100:00100000:3.0:1787432922.952451:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609569024 00000100:00100000:3.0:1787432922.952508:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609568512 00000100:00100000:3.0:1787432922.952511:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609568512 00000100:00100000:3.0:1787432922.952531:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432922.952538:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840356b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609569024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432922.952586:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840356b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609569024:12345-0@lo:400:kworker.0 Request processed in 48us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432922.952593:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432922.952608:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432922.952615:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840356a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609568512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432922.952655:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840356a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609568512:12345-0@lo:400:kworker.0 Request processed in 40us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432922.952661:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432922.952700:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609568384 00000100:00100000:3.0:1787432922.952704:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609568384 00000100:00100000:3.0:1787432922.952728:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609568896 00000100:00100000:3.0:1787432922.952731:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609568896 00000100:00100000:3.0:1787432922.952744:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787432922.952750:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609568384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432922.952785:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609568384:12345-0@lo:400:kworker.0 Request processed in 35us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432922.952791:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787432922.952803:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787432922.952809:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609568896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432922.952840:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609568896:12345-0@lo:400:kworker.0 Request processed in 31us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432922.952846:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787432922.952862:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1787432922.953088:0:25052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787432922.953130:0:25052:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787432922.953143:0:25052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xca72b3b33564091e 00000100:00080000:3.0:1787432922.953150:0:25052:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787432922.953153:0:25052:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff948302521800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432922.953201:0:25052:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948304568700 x1874258609569664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432922.953214:0:25052:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787432922.959876:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609568384:0@lo:400:kworker.0 00000100:00100000:0.0:1787432922.959896:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609569024:0@lo:400:kworker.0 00000100:00100000:0.0:1787432922.959924:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609568512:0@lo:400:kworker.0 00000100:00100000:0.0:1787432922.959950:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609568640:0@lo:8:kworker.0 00000100:00100000:0.0:1787432922.960012:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432922.960034:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609569152:0@lo:8:kworker.0 00000100:00100000:0.0:1787432922.960056:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432922.960074:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874258609569664:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787432922.960103:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432922.960196:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609568256 00000100:00100000:2.0:1787432922.960203:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609568256 00000100:00100000:2.0:1787432922.960253:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609569280 00000100:00100000:2.0:1787432922.960257:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609569280 00000100:00100000:2.0:1787432922.960289:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787432922.960298:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483026fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609569280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432922.960352:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483026fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609569280:12345-0@lo:400:kworker.0 Request processed in 55us (8054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432922.960366:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787432922.960383:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432922.960388:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874258609568256:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787432922.960409:0:22718:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 734 last 0 00000020:00000080:2.0:1787432922.960440:0:22718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xca72b3b335640925 00000004:00100000:2.0:1787432922.960455:0:22718:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787432922.960484:0:22718:0:(import.c:65:import_set_state_nolock()) ffff948301daa000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432922.960519:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874258609568256:12345-0@lo:38:llog_process_th.0 Request processed in 130us (8785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432922.960525:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:2.0:1787432922.961435:0:25052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00010000:00080000:1.0:1787432922.965287:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948403568000 x1874258609569280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432922.965308:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609569280:0@lo:400:kworker.0 00000100:00100000:1.0:1787432922.965367:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609568640 00000100:00100000:1.0:1787432922.965374:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609568640 00000100:00100000:1.0:1787432922.965401:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609569152 00000100:00100000:1.0:1787432922.965403:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609569152 00000100:00100000:1.0:1787432922.965418:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787432922.965425:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483026fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874258609568640:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787432922.965514:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483026fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874258609568640:12345-0@lo:8:kworker.0 Request processed in 87us (5501us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787432922.965522:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787432922.965538:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432922.965542:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483026fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874258609569152:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787432922.965577:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483026fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874258609569152:12345-0@lo:8:kworker.0 Request processed in 32us (5519us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787432922.965583:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432922.965619:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609568768:0@lo:400:kworker.0 00010000:00080000:0.0:1787432922.965887:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948303a38000 x1874258609568256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432922.965897:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787432922.965908:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787432922.965918:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787432922.965924:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787432922.965929:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948301da9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787432922.965936:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609568256:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787432922.965962:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787432922.965966:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948304f08000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432922.965970:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787432922.965973:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609568640:0@lo:8:kworker.0 00000100:00100000:0.0:1787432922.965999:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787432922.966002:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432922.966006:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787432922.966008:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609569152:0@lo:8:kworker.0 00000100:00100000:0.0:1787432922.966047:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609569664 00000100:00100000:0.0:1787432922.966051:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609569664 00000100:00100000:0.0:1787432922.966074:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787432922.966080:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483026fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874258609569664:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787432922.966098:0:22718:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 734 last 0 00000020:00000080:0.0:1787432922.966132:0:22718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xca72b3b33564092c 00000004:00100000:0.0:1787432922.966147:0:22718:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787432922.966200:0:22718:0:(import.c:65:import_set_state_nolock()) ffff9483032e8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432922.966262:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483026fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874258609569664:12345-0@lo:38:llog_process_th.0 Request processed in 181us (6157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432922.966269:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787432922.966296:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948304568700 x1874258609569664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432922.966305:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787432922.966309:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787432922.966314:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787432922.966317:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787432922.966319:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948302521800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787432922.966324:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874258609569664:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1787432922.966343:0:25039:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787432922.966380:0:25039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787432922.966401:0:25039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85fc00/0xca72b3b3356408fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640902 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.966411:0:25039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85fc00/0xca72b3b3356408fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640902 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787432922.966467:0:25039:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787432922.966469:0:25039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787432922.966471:0:25039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432922.966472:0:25039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432922.966473:0:25039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432922.966474:0:25039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432922.966476:0:25039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787432922.966478:0:25039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432922.966480:0:25039:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787432922.966483:0:25039:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787432922.966485:0:25039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787432922.966487:0:25039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787432922.966488:0:25039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432922.966489:0:25039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432922.966490:0:25039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432922.966491:0:25039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432922.966492:0:25039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787432922.966494:0:25039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432922.966495:0:25039:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787432922.966512:0:25039:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787432922.966526:0:25039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609569792:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787432922.966562:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432922.966580:0:25039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484048c9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787432922.966656:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432922.966704:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609568896:0@lo:400:kworker.0 00000100:00100000:1.0:1787432922.966727:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432922.966757:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948403569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609569408:0@lo:400:kworker.0 00000100:00100000:1.0:1787432922.966787:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432922.966814:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609569536 00000100:00100000:1.0:1787432922.966818:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609569536 00000100:00100000:1.0:1787432922.966848:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609568768 00000100:00100000:1.0:1787432922.966851:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609568768 00000100:00100000:1.0:1787432922.966864:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609569408 00000100:00100000:1.0:1787432922.966867:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609569408 00000100:00100000:1.0:1787432922.966882:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787432922.966889:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609569536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432922.966927:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609569536:12345-0@lo:400:kworker.0 Request processed in 38us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432922.966934:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787432922.966947:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787432922.966953:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609568768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432922.966986:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609568768:12345-0@lo:400:kworker.0 Request processed in 33us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432922.966993:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787432922.967005:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787432922.967012:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609569408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432922.967038:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609569408:12345-0@lo:400:kworker.0 Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432922.967044:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787432922.967074:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94840356b480 x1874258609569536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432922.967083:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609569536:0@lo:400:kworker.0 00010000:00080000:1.0:1787432922.967118:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94842726ca80 x1874258609568768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432922.967127:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609568768:0@lo:400:kworker.0 00010000:00080000:1.0:1787432922.967136:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948403569f80 x1874258609569408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432922.967143:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948403569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609569408:0@lo:400:kworker.0 00000100:00100000:3.0:1787432922.968394:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609569792 00000100:00100000:3.0:1787432922.968403:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609569792 00000100:00100000:3.0:1787432922.969540:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787432922.969555:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b141c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+24:25039:x1874258609569792:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787432922.969602:0:22711:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787432922.969615:0:22711:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1787432922.969735:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432922.969742:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 20000000:01000000:3.0:1787432922.976717:0:22711:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787432922.976743:0:22711:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787432922.976768:0:22734:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787432922.976774:0:22734:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787432922.976795:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9484013fd400/0xca72b3b335640933 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.976813:0:22734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948302690000/0xca72b3b3356407c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356407b9 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.976829:0:22734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948302690c00/0xca72b3b3356407ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356407c7 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.976837:0:22734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9484013fd400/0xca72b3b335640933 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.976881:0:22734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948302690c00/0xca72b3b3356407ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b3356407c7 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.976897:0:22734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948302690c00/0xca72b3b3356407ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b3356407c7 expref: 24 pid: 22711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432922.976914:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026fe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22734:1874258609569920:0@lo:104: 00000100:00100000:0.0:1787432922.977001:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432922.977060:0:22734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948302690000/0xca72b3b3356407c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b3356407b9 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.977068:0:22734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948302690000/0xca72b3b3356407c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b3356407b9 expref: 24 pid: 22711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432922.977077:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026ff480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22734:1874258609570048:0@lo:104: 00000100:00100000:0.0:1787432922.977097:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432922.977119:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff948401684b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432922.977126:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609569920 00000100:00100000:1.0:1787432922.977135:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609569920 00000100:00100000:1.0:1787432922.977193:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609570048 00000100:00100000:1.0:1787432922.977196:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609570048 00000100:00100000:1.0:1787432922.977212:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787432922.977231:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483026fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a13c04c-dd5b-4f06-b031-814868f35d81+4:22734:x1874258609569920:12345-0@lo:104: 00010000:00010000:1.0:1787432922.977243:0:22702:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b3356407c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356407ce expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.977299:0:22702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432922.977305:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483026fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a13c04c-dd5b-4f06-b031-814868f35d81+4:22734:x1874258609569920:12345-0@lo:104: Request processed in 85us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432922.977312:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787432922.977327:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787432922.977330:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026fe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22734:1874258609569920:0@lo:104: 00000100:00100000:1.0:1787432922.977333:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483026fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a13c04c-dd5b-4f06-b031-814868f35d81+3:22734:x1874258609570048:12345-0@lo:104: 00010000:00010000:1.0:1787432922.977341:0:22702:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b3356407b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356407c0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.977385:0:22702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787432922.977390:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483026fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a13c04c-dd5b-4f06-b031-814868f35d81+3:22734:x1874258609570048:12345-0@lo:104: Request processed in 57us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432922.977403:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787432922.977420:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432922.977425:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b3356407c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356407ce expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.977433:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fd600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432922.977437:0:22707:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b3356407c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b3356407ce expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.977445:0:22707:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b3356407c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b3356407ce expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432922.977450:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026ff480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22734:1874258609570048:0@lo:104: 10000000:00010000:1.0:1787432922.977453:0:22707:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b3356407c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b3356407ce expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432922.977459:0:22707:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432922.977469:0:22734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9484013fd400/0xca72b3b335640933 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.977486:0:22707:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b3356407c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356407ce expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.977491:0:22707:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432922.977512:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b3356407c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356407ce expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.977519:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b3356407c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356407ce expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432922.977523:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a13c04c-dd5b-4f06-b031-814868f35d81:3641:1874258609570176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432922.977530:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432922.977534:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b3356407b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356407c0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432922.977551:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432922.977589:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609570176 00000100:00100000:0.0:1787432922.977593:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609570176 00010000:00010000:0.0:1787432922.977612:0:22705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948302690c00/0xca72b3b3356407ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356407c7 expref: 25 pid: 22711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432922.977634:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787432922.977640:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483026ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+25:3641:x1874258609570176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432922.977651:0:22705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432922.977656:0:22705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948302690c00/0xca72b3b3356407ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356407c7 expref: 25 pid: 22711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.977666:0:22705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948302690c00/0xca72b3b3356407ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b3356407c7 expref: 25 pid: 22711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.977680:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948302690c00/0xca72b3b3356407ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b3356407c7 expref: 25 pid: 22711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432922.977702:0:22705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432922.977730:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483026ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:3641:x1874258609570176:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432922.977736:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787432922.977759:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a13c04c-dd5b-4f06-b031-814868f35d81:3641:1874258609570176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787432922.977784:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b141c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+23:25039:x1874258609569792:12345-0@lo:253:mount.lustre.0 Request processed in 8233us (11220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432922.977794:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787432922.977839:0:25039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a13c04c-dd5b-4f06-b031-814868f35d81:25039:1874258609569792:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787432922.977849:0:25039:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787432922.977853:0:25039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787432922.977855:0:25039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787432922.977856:0:25039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432922.977857:0:25039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432922.977858:0:25039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432922.977860:0:25039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432922.977861:0:25039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432922.977863:0:25039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432922.977865:0:25039:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787432922.977958:0:25039:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1787432922.978284:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432922.979447:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f05e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432922.979456:0:22707:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b3356407b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b3356407c0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.979468:0:22707:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b3356407b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b3356407c0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432922.979476:0:22707:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b3356407b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b3356407c0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432922.979483:0:22707:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432922.979512:0:22707:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b3356407b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356407c0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.979518:0:22707:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432922.979539:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b3356407b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356407c0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.979546:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b3356407b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356407c0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.979626:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432922.979628:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432922.979630:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432922.979657:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a13c04c-dd5b-4f06-b031-814868f35d81:3642:1874258609570304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432922.979705:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432922.979752:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609570304 00000100:00100000:1.0:1787432922.979757:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609570304 00010000:00010000:1.0:1787432922.979778:0:22706:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948302690000/0xca72b3b3356407c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356407b9 expref: 23 pid: 22711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432922.979812:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432922.979820:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434898000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a13c04c-dd5b-4f06-b031-814868f35d81+23:3642:x1874258609570304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432922.979832:0:22706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432922.979837:0:22706:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948302690000/0xca72b3b3356407c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356407b9 expref: 23 pid: 22711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.979848:0:22706:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948302690000/0xca72b3b3356407c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b3356407b9 expref: 23 pid: 22711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.979862:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948302690000/0xca72b3b3356407c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b3356407b9 expref: 23 pid: 22711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.980000:0:22706:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9484013fd400/0xca72b3b335640933 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.980010:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fd400/0xca72b3b335640933 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787432922.980025:0:22706:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012002050s 00010000:00010000:1.0:1787432922.980029:0:22706:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484013fd400/0xca72b3b335640933 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.980037:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484013fd400/0xca72b3b335640933 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.980044:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9484013fd400/0xca72b3b335640933 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.980050:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9484013fd400/0xca72b3b335640933 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.980060:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fd400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432922.980064:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9484013fd400/0xca72b3b335640933 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.980071:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9484013fd400/0xca72b3b335640933 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.980086:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9484013fd400/0xca72b3b335640933 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.980095:0:22706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432922.980125:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434898000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a13c04c-dd5b-4f06-b031-814868f35d81+22:3642:x1874258609570304:12345-0@lo:103:ldlm_bl.0 Request processed in 306us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432922.980132:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432922.980184:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a13c04c-dd5b-4f06-b031-814868f35d81:3642:1874258609570304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432922.980207:0:22734:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9484013fd400/0xca72b3b335640933 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.980215:0:22734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9484013fd400/0xca72b3b335640933 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432922.980230:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fd400/0xca72b3b335640933 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1787432922.982813:0:25039:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1787432922.991470:0:25039:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787432922.991484:0:25039:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787432922.991519:0:25039:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787432922.991626:0:25039:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.124@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787432922.991648:0:25039:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787432922.991674:0:25039:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787432922.992400:0:25039:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432922.992631:0:25039:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787432923.085348:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432923.085372:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609570432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432923.085439:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432923.085645:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609570432 00000100:00100000:0.0:1787432923.085655:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609570432 00000100:00100000:0.0:1787432923.085731:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432923.085742:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609570432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432923.085773:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787432923.085842:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609570432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432923.085850:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432923.085896:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609570432:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787432923.277145:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787432923.850988:0:25105:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787432923.851403:0:25105:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787432924.309321:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787432924.498410:0:22716:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787432924.498420:0:22716:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94840557e000 from 14 10000000:01000000:0.0:1787432924.498436:0:22716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787432924.498494:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33564093a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.498507:0:22716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33564093a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.498521:0:22716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33564093a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432924.498550:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609570560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787432924.499759:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432924.499824:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff94843ddc9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432924.500004:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609570560 00000100:00100000:3.0:1787432924.500013:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609570560 00000100:00100000:3.0:1787432924.500066:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787432924.500084:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b141850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+22:22716:x1874258609570560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432924.500099:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432924.500118:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94843f85f200/0xca72b3b335640941 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33564093a expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.500146:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94843f85f200/0xca72b3b335640941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33564093a expref: 23 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.500155:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94843f85f200/0xca72b3b335640941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564093a expref: 23 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.500182:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85f200, rc 0) 00000100:00100000:3.0:1787432924.500248:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b141850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+23:22716:x1874258609570560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432924.500254:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787432924.501025:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609570560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432924.501044:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33564093a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640941 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.501068:0:22716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33564093a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640941 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432924.501140:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609570688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787432924.501216:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432924.501249:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff94843ddc9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432924.501265:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609570688 00000100:00100000:0.0:1787432924.501270:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609570688 00000100:00100000:0.0:1787432924.501318:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787432924.501328:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b142850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+23:22716:x1874258609570688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787432924.501344:0:22711:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787432924.501362:0:22711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787432924.501365:0:22711:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1787432924.501455:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b142850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+23:22716:x1874258609570688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432924.501463:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787432924.501497:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609570688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787432924.501557:0:22716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787432924.501564:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33564093a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640941 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.501572:0:22716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33564093a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640941 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432924.501582:0:22716:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787432924.501585:0:22716:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94844112f000 from 14 10000000:01000000:0.0:1787432924.501593:0:22716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787432924.501617:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b335640948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.501625:0:22716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b335640948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.501634:0:22716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b335640948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432924.502009:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609570816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787432924.502043:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432924.502071:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff94843ddc9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432924.503019:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609570816 00000100:00100000:1.0:1787432924.503029:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609570816 00000100:00100000:1.0:1787432924.503093:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787432924.503104:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b142450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+23:22716:x1874258609570816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432924.503118:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432924.503135:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302774a00/0xca72b3b33564094f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b335640948 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432924.503180:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302774a00/0xca72b3b33564094f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b335640948 expref: 24 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432924.503203:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302774a00/0xca72b3b33564094f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b335640948 expref: 24 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432924.503212:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302774a00, rc 0) 00000100:00100000:1.0:1787432924.503274:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b142450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+24:22716:x1874258609570816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432924.503281:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787432924.503460:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609570816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432924.503475:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b335640948 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33564094f expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.503485:0:22716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b335640948 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33564094f expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432924.503551:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609570944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787432924.503589:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432924.503809:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff94843ddc9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432924.503936:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609570944 00000100:00100000:1.0:1787432924.503941:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609570944 00000100:00100000:1.0:1787432924.503980:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787432924.503989:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b140450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:22716:x1874258609570944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787432924.504004:0:22712:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787432924.504027:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787432924.504030:0:22712:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787432924.504125:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b140450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:22716:x1874258609570944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432924.504132:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787432924.504248:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609570944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787432924.504323:0:22716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787432924.504331:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b335640948 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33564094f expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.504352:0:22716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b335640948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33564094f expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787432924.751080:0:22754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787432925.135048:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609571072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432925.135150:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432925.135324:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609571072 00000100:00100000:1.0:1787432925.135332:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609571072 00000100:00100000:1.0:1787432925.135393:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787432925.135403:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609571072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787432925.135434:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787432925.135480:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609571072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432925.135487:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787432925.135508:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432925.135545:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609571072:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787432925.323499:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432926.155522:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609571200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432926.155598:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432926.155660:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609571200 00000100:00100000:0.0:1787432926.155668:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609571200 00000100:00100000:0.0:1787432926.155716:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787432926.155727:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483026fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609571200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432926.155768:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787432926.155818:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483026fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609571200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432926.155825:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787432926.155871:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609571200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432926.160548:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609571328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432926.160620:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432926.160716:0:23798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609571328 00000100:00100000:2.0:1787432926.160727:0:23798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609571328 00000100:00100000:2.0:1787432926.160786:0:23798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787432926.160797:0:23798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840356b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609571328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787432926.160836:0:23798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787432926.160888:0:23798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840356b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609571328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432926.160895:0:23798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787432926.160943:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609571328:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787432926.348189:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787432927.244634:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787432927.371436:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432928.206070:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432928.206077:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787432928.206081:0:8:0:(import.c:65:import_set_state_nolock()) ffff948304f08000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432928.206094:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948304f08000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432928.206127:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9483026fd880 x1874258609571840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432928.206180:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432928.206183:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787432928.206193:0:8:0:(import.c:65:import_set_state_nolock()) ffff94843c7f0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432928.206199:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94843c7f0000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432928.206214:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9483026ff100 x1874258609572352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432928.206271:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609571584:0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.206339:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.206393:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609572224:0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.206418:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.206434:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609572864:0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.206457:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.206481:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787432928.206486:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a13c04c-dd5b-4f06-b031-814868f35d81:3644:1874258609571456:0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.206512:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.206535:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609572096:0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.206556:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.206574:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948434898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609572736:0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.206599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.206622:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609571968:0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.206658:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.206676:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609572608:0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.206700:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.206720:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787432928.206726:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609571712:0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.206747:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.206769:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609572480:0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.206789:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.206799:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94842726d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609572992:0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.206816:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.206835:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609571840:0@lo:8:kworker.0 00000100:00100000:0.0:1787432928.206857:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.206872:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483026ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609572352:0@lo:8:kworker.0 00000100:00100000:0.0:1787432928.206892:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.206933:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609571584 00000100:00100000:0.0:1787432928.206941:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609571584 00000100:00100000:0.0:1787432928.206981:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609572096 00000100:00100000:0.0:1787432928.206984:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609572096 00000100:00100000:0.0:1787432928.207000:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787432928.207010:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609571584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.207079:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609571584:12345-0@lo:400:kworker.0 Request processed in 70us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432928.207087:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787432928.207105:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787432928.207111:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609572096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.207151:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609572096:12345-0@lo:400:kworker.0 Request processed in 41us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432928.207157:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787432928.207194:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609571456 00000100:00100000:0.0:1787432928.207198:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609571456 00000100:00100000:0.0:1787432928.207222:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787432928.207228:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b143c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+24:3644:x1874258609571456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.207267:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b143c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+24:3644:x1874258609571456:12345-0@lo:400:kworker.0 Request processed in 40us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432928.207273:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787432928.207305:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609572864 00000100:00100000:0.0:1787432928.207309:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609572864 00000100:00100000:0.0:1787432928.207338:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609572736 00000100:00100000:0.0:1787432928.207341:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609572736 00000100:00100000:0.0:1787432928.207354:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609571968 00000100:00100000:0.0:1787432928.207357:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609571968 00000100:00100000:0.0:1787432928.207368:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609572608 00000100:00100000:0.0:1787432928.207370:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609572608 00000100:00100000:0.0:1787432928.207380:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609572480 00000100:00100000:0.0:1787432928.207382:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609572480 00000100:00100000:0.0:1787432928.207392:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609572992 00000100:00100000:0.0:1787432928.207394:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609572992 00000100:00100000:0.0:1787432928.207407:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787432928.207412:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609572864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.207443:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609572864:12345-0@lo:400:kworker.0 Request processed in 30us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432928.207449:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787432928.207460:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787432928.207466:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609572736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.207493:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609572736:12345-0@lo:400:kworker.0 Request processed in 27us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432928.207498:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787432928.207509:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787432928.207515:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609571968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.207547:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609571968:12345-0@lo:400:kworker.0 Request processed in 33us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432928.207560:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787432928.207572:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787432928.207578:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609572608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.207606:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609572608:12345-0@lo:400:kworker.0 Request processed in 28us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432928.207611:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787432928.207620:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787432928.207625:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609572480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.207645:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609572480:12345-0@lo:400:kworker.0 Request processed in 20us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432928.207649:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787432928.207657:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787432928.207662:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609572992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.207682:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609572992:12345-0@lo:400:kworker.0 Request processed in 20us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432928.207686:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787432928.207724:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483026fca80 x1874258609572480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432928.207738:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609572480:0@lo:400:kworker.0 00010000:00080000:0.0:1787432928.207749:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94842726d180 x1874258609572992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432928.207757:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609572992:0@lo:400:kworker.0 00010000:00080000:0.0:1787432928.207766:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483026fc380 x1874258609571968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432928.207779:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609571968:0@lo:400:kworker.0 00010000:00080000:0.0:1787432928.207790:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483026fe300 x1874258609572608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432928.207798:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609572608:0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.207827:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a13c04c-dd5b-4f06-b031-814868f35d81:3644:1874258609571456:0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.207837:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609572096:0@lo:400:kworker.0 00010000:00080000:0.0:1787432928.207846:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948434898a80 x1874258609572736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432928.207854:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948434898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609572736:0@lo:400:kworker.0 00000100:00100000:0.0:1787432928.207863:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609571584:0@lo:400:kworker.0 00010000:00080000:0.0:1787432928.207872:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94842726ca80 x1874258609572864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432928.207880:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94842726ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609572864:0@lo:400:kworker.0 00000100:00100000:1.0:1787432928.208125:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432928.208137:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609573120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432928.208182:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432928.208221:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609572224 00000100:00100000:1.0:1787432928.208225:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609572224 00000100:00100000:1.0:1787432928.208254:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609571712 00000100:00100000:1.0:1787432928.208257:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609571712 00000100:00100000:1.0:1787432928.208270:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609571840 00000100:00100000:1.0:1787432928.208273:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609571840 00000100:00100000:1.0:1787432928.208282:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609572352 00000100:00100000:1.0:1787432928.208285:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609572352 00000100:00100000:1.0:1787432928.208294:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787432928.208301:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842726f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609572224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432928.208341:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842726f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609572224:12345-0@lo:400:kworker.0 Request processed in 40us (1922us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432928.208354:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787432928.208367:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787432928.208372:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609571712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432928.208400:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609571712:12345-0@lo:400:kworker.0 Request processed in 29us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432928.208406:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787432928.208416:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787432928.208422:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874258609571840:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787432928.208448:0:24227:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 739 last 0 00000020:00000080:1.0:1787432928.208474:0:24227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b335640956 00002000:00100000:1.0:1787432928.208485:0:24227:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff94841d298800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787432928.208489:0:24227:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787432928.208492:0:24227:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787432928.208681:0:24227:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787432928.208707:0:24227:0:(import.c:65:import_set_state_nolock()) ffff94841d29b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432928.208747:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874258609571840:12345-0@lo:8:kworker.0 Request processed in 324us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432928.208753:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787432928.208764:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787432928.208768:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874258609572352:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787432928.208781:0:24227:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 739 last 0 00000020:00000080:1.0:1787432928.208797:0:24227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b33564095d 00002000:00100000:1.0:1787432928.208803:0:24227:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff94841d29a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1787432928.208806:0:24227:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1787432928.208814:0:24227:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787432928.208837:0:24227:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1787432928.208850:0:24227:0:(import.c:65:import_set_state_nolock()) ffff94841d29e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432928.208879:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1874258609572352:12345-0@lo:8:kworker.0 Request processed in 109us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432928.208884:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787432928.208933:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432928.208938:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432928.208940:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787432928.208975:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483026fd880 x1874258609571840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787432953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787432928.208987:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787432928.208997:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787432928.209002:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787432928.209005:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948304f08000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787432928.209076:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609573120 00000100:00100000:2.0:1787432928.209082:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609573120 00000100:00100000:2.0:1787432928.209127:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432928.209135:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609573120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432928.209185:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787432928.209226:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609573120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432928.209233:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:2.0:1787432928.209275:0:22746:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1787432928.209294:0:22746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22746:1874258609573376:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787432928.209323:0:22746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432928.209341:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037ea540 going to sleep for 11 seconds 00000100:00100000:2.0:1787432928.209358:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609573248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432928.209380:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432928.209416:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609573120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432928.209434:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609573248 00000100:00100000:2.0:1787432928.209437:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609573248 00000100:00100000:2.0:1787432928.209458:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787432928.209464:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1874258609573248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432928.209475:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787432928.209504:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1874258609573248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432928.209509:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787432928.209523:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787432928.209539:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303a38000 x1874258609573248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432928.209551:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609573248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432928.209567:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609573376 00000100:00100000:2.0:1787432928.209571:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609573376 00000100:00100000:2.0:1787432928.209599:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787432928.209605:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22746:x1874258609573376:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787432928.211461:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609571712:0@lo:400:kworker.0 00000004:00080000:1.0:1787432928.211590:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787432928.211601:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609571840:0@lo:8:kworker.0 00010000:00080000:1.0:1787432928.211623:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483026ff100 x1874258609572352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787432953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787432928.211641:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1787432928.211654:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787432928.211661:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787432928.211665:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f0000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787432928.211686:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787432928.211689:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609572352:0@lo:8:kworker.0 00000100:00100000:1.0:1787432928.211734:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483026fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609572224:0@lo:400:kworker.0 00000004:00080000:0.0:1787432928.211849:0:23464:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787432928.211873:0:23464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483036e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23464:1874258609573632:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787432928.211954:0:23464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.211987:0:23464:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840f49d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787432928.212003:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432928.212012:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483036e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609573504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432928.212054:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.212086:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609573504 00000100:00100000:0.0:1787432928.212093:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609573504 00000100:00100000:0.0:1787432928.212159:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787432928.212197:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1874258609573504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787432928.212221:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787432928.212272:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1874258609573504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432928.212280:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787432928.212302:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432928.212318:0:24225:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787432928.212325:0:24225:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:0.0:1787432928.212449:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483036e0000 x1874258609573504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432928.212466:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483036e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609573504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432928.212498:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609573632 00000100:00100000:0.0:1787432928.212501:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609573632 00000100:00100000:0.0:1787432928.212592:0:25334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787432928.212599:0:25334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23464:x1874258609573632:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1787432928.212885:0:22745:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787432928.212982:0:22745:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739304817485ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787432928.212990:0:22745:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787432928.213010:0:23463:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787432928.213052:0:23463:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 739304887455ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787432928.213057:0:23463:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00080000:2.0:1787432928.218863:0:24227:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787432928.218875:0:24227:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1787432928.218883:0:24227:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000004:00080000:0.0:1787432928.222546:0:22699:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787432928.226127:0:23453:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1787432928.226190:0:25334:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787432928.226197:0:25334:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787432928.226301:0:25334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23464:x1874258609573632:12345-0@lo:7:osp-pre-1-1.0 Request processed in 13697us (14342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432928.226314:0:25334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787432928.226363:0:23464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483036e2d80 x1874258609573632/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787432944 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432928.226390:0:23464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483036e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23464:1874258609573632:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1787432928.226403:0:23464:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787432928.226445:0:23464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483036e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23464:1874258609573760:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787432928.226481:0:23464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.226503:0:23464:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840f49d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787432928.226519:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609573760 00000100:00100000:0.0:1787432928.226524:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609573760 00000100:00100000:0.0:1787432928.226567:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787432928.226576:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23464:x1874258609573760:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787432928.226602:0:24225:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1787432928.226629:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23464:x1874258609573760:12345-0@lo:5:osp-pre-1-1.0 Request processed in 54us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432928.226635:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787432928.226657:0:23464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483036e2d80 x1874258609573760/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432944 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432928.226666:0:23464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483036e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23464:1874258609573760:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787432928.226673:0:23464:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787432928.226694:0:23464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483036e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23464:1874258609573888:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787432928.226714:0:23464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432928.226728:0:23464:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840f49d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787432928.226737:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609573888 00000100:00100000:0.0:1787432928.226740:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609573888 00000100:00100000:0.0:1787432928.226757:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787432928.226763:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23464:x1874258609573888:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787432928.226791:0:24225:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:2.0:1787432928.238768:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787432928.238785:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000430dfbae/0xca72b3b335640964 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.238804:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=739s v=(0 0) 00010000:00010000:2.0:1787432928.238809:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432928.242758:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000430dfbae/0xca72b3b335640964 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.242795:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000430dfbae/0xca72b3b335640964 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.242862:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000430dfbae/0xca72b3b335640964 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.242872:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000430dfbae/0xca72b3b335640964 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.243216:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432928.243234:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432928.243241:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000430dfbae/0xca72b3b335640964 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.243250:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f05400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.243269:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000430dfbae/0xca72b3b335640964 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.243279:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000430dfbae/0xca72b3b335640964 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.243309:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000430dfbae/0xca72b3b335640964 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.243316:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000430dfbae/0xca72b3b335640964 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.243345:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.243347:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.243349:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432928.250048:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432928.250063:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b33564096b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.250387:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1787432928.250393:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432928.250400:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b33564096b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.250416:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b33564096b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.250426:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b33564096b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.250448:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b33564096b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.250470:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432928.250484:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432928.250496:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b33564096b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.250504:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fa00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432928.250509:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b33564096b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.250518:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b33564096b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.250537:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b33564096b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.250545:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b33564096b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.250566:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432928.250568:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432928.250569:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432928.254216:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.254229:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b335640972 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.254248:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.254253:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.254259:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b335640972 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.254286:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b335640972 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.254298:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b335640972 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.254306:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b335640972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.254329:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787432928.254995:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.255003:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b335640979 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255014:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.255017:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.255022:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b335640979 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255033:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b335640979 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255041:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b335640979 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255058:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b335640979 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255073:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787432928.255084:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432928.255090:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b335640972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255098:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432928.255102:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b335640972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255111:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b335640972 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255138:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b335640972 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255145:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b335640972 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255177:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432928.255181:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b335640979 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255199:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432928.255203:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b335640979 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255210:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b335640979 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255220:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b335640979 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255227:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b335640979 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255242:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432928.255243:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432928.255245:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.255389:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432928.255678:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.255685:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb67b90/0xca72b3b335640980 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255694:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.255697:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.255701:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb67b90/0xca72b3b335640980 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255711:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdb67b90/0xca72b3b335640980 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255726:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb67b90/0xca72b3b335640980 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255733:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb67b90/0xca72b3b335640980 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.255757:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787432928.256035:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.256041:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8611d82/0xca72b3b335640987 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.256048:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.256051:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.256055:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8611d82/0xca72b3b335640987 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.256062:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8611d82/0xca72b3b335640987 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.256069:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8611d82/0xca72b3b335640987 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.256087:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8611d82/0xca72b3b335640987 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.256114:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787432928.257054:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.257062:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067cb083e/0xca72b3b33564098e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.257084:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.257088:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.257092:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067cb083e/0xca72b3b33564098e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.257101:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067cb083e/0xca72b3b33564098e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.257109:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067cb083e/0xca72b3b33564098e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.257126:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067cb083e/0xca72b3b33564098e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.257136:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787432928.257728:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.257737:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640995 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.257747:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.257755:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.257759:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640995 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.257769:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640995 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.257777:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640995 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.257984:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787432928.257993:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdb67b90/0xca72b3b335640980 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.258001:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775600 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.258006:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb67b90/0xca72b3b335640980 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.258014:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb67b90/0xca72b3b335640980 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.258030:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdb67b90/0xca72b3b335640980 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.258037:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdb67b90/0xca72b3b335640980 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.258055:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432928.258058:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8611d82/0xca72b3b335640987 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.258075:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774800 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.258079:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8611d82/0xca72b3b335640987 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.258086:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8611d82/0xca72b3b335640987 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.258097:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8611d82/0xca72b3b335640987 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.258104:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8611d82/0xca72b3b335640987 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.258129:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432928.258133:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067cb083e/0xca72b3b33564098e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.258139:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.258142:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067cb083e/0xca72b3b33564098e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.258149:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067cb083e/0xca72b3b33564098e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.258158:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067cb083e/0xca72b3b33564098e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.258185:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067cb083e/0xca72b3b33564098e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.258198:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.258200:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.258202:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.258208:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432928.258744:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640995 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.258760:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787432928.259438:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.259446:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b33564099c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.259611:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.259615:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.259622:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b33564099c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.259636:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b33564099c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.259646:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b33564099c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.259660:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b33564099c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.259674:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787432928.260380:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.260387:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b3356409a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.260399:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.260402:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.260407:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b3356409a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.260416:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b3356409a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.260425:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b3356409a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.260433:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b3356409a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.260441:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787432928.260986:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.260993:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b3356409aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.261008:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.261011:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.261016:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b3356409aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.261025:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b3356409aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.261033:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b3356409aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.261041:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b3356409aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.261049:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787432928.261671:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.261678:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.261687:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.261746:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.261751:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.261761:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.261780:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.261896:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.261907:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1787432928.262449:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787432928.262458:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640995 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262467:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775e00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.262473:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640995 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262482:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640995 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262502:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640995 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262510:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640995 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262532:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787432928.262536:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b33564099c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262549:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.262553:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b33564099c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262560:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b33564099c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262571:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b33564099c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262578:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b33564099c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262591:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787432928.262595:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b3356409a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262601:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774e00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.262605:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b3356409a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262614:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b3356409a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262624:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b3356409a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262638:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b3356409a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262652:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432928.262655:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b3356409aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262662:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774c00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.262665:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b3356409aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262672:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b3356409aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262682:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b3356409aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262689:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b3356409aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262701:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432928.262704:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262711:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775a00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.262720:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262727:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262737:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262744:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262757:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.262759:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.262761:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432928.262762:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.262768:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.262778:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.262792:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.262798:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.262808:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.262821:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.262829:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.262838:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432928.262861:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432928.262950:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432928.262955:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262964:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.262967:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262974:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262985:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.262997:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.263011:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.263013:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.263015:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432928.264924:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.264939:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007606616e/0xca72b3b3356409bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.264955:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.264959:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.264965:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007606616e/0xca72b3b3356409bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.264978:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007606616e/0xca72b3b3356409bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.264988:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007606616e/0xca72b3b3356409bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.264995:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007606616e/0xca72b3b3356409bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.265011:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787432928.265996:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.266007:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b3356409c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.266019:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.266028:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.266034:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b3356409c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.266045:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b3356409c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.266053:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b3356409c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.266061:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b3356409c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.266141:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787432928.267747:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432928.267760:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007606616e/0xca72b3b3356409bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.267785:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775800 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432928.267790:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007606616e/0xca72b3b3356409bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.267800:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007606616e/0xca72b3b3356409bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.267827:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007606616e/0xca72b3b3356409bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.267836:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007606616e/0xca72b3b3356409bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.267859:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432928.267863:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b3356409c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.267870:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775c00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432928.267874:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b3356409c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.267882:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b3356409c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.267892:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b3356409c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.267905:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b3356409c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.267918:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432928.267919:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432928.267921:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432928.267975:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.267982:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d906434d/0xca72b3b3356409cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.267994:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.267998:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.268003:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d906434d/0xca72b3b3356409cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.268015:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d906434d/0xca72b3b3356409cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.268024:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d906434d/0xca72b3b3356409cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.268036:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d906434d/0xca72b3b3356409cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.269574:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432928.270006:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432928.270014:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d906434d/0xca72b3b3356409cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.270025:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432928.270030:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d906434d/0xca72b3b3356409cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.270039:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d906434d/0xca72b3b3356409cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.270056:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d906434d/0xca72b3b3356409cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.270064:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d906434d/0xca72b3b3356409cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.270086:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432928.270087:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432928.270089:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.270417:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432928.270947:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.270955:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb72e0e3/0xca72b3b3356409d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.270968:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.270973:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.270979:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb72e0e3/0xca72b3b3356409d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.270990:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb72e0e3/0xca72b3b3356409d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.271000:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb72e0e3/0xca72b3b3356409d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.271007:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb72e0e3/0xca72b3b3356409d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.271026:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432928.272753:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432928.272764:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb72e0e3/0xca72b3b3356409d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.272777:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774600 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432928.272782:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb72e0e3/0xca72b3b3356409d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.272792:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb72e0e3/0xca72b3b3356409d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432928.273873:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432928.273885:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b3356409db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.273900:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1787432928.273905:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432928.273912:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b3356409db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.273927:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b3356409db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.273938:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b3356409db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.273945:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b3356409db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.273966:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432928.273992:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432928.277091:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb72e0e3/0xca72b3b3356409d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.277128:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb72e0e3/0xca72b3b3356409d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.277161:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432928.277177:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432928.277179:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432928.278969:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432928.278981:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b3356409e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.278999:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1787432928.279005:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432928.279012:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b3356409e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.279026:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b3356409e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.279036:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b3356409e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.279043:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b3356409e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.279061:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432928.280067:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432928.280077:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b3356409e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.280088:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432928.280093:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b3356409e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.280114:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b3356409e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.280143:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b3356409e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.280151:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b3356409e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.280188:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432928.280190:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432928.280191:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432928.280382:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432928.280386:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432928.280394:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432928.280480:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.280488:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b3356409e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.280499:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.280503:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.280509:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b3356409e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.280520:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b3356409e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.280528:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b3356409e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.280535:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b3356409e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.280557:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432928.280584:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432928.280589:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b3356409e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.280597:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.280600:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b3356409e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.280618:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b3356409e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.280630:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b3356409e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.280637:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c059fe8/0xca72b3b3356409e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.280653:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.280655:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.280657:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432928.280790:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b3356409db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.280799:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432928.280802:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b3356409db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787432928.281249:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.281255:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b3356409f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.281266:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.281269:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.281274:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b3356409f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.281295:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b3356409f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.281303:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b3356409f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.281311:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b3356409f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.281331:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432928.281408:0:25337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432928.281414:0:25337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b3356409f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.281422:0:25337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.281426:0:25337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b3356409f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.281433:0:25337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b3356409f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.281444:0:25337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b3356409f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.281471:0:25337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8cfde6/0xca72b3b3356409f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.281486:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.281488:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.281489:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432928.281790:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.281796:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.281805:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.281808:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.281979:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.281990:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.281998:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.282016:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.282031:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432928.282308:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432928.282314:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.282322:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.282325:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.282333:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787432928.282339:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.282343:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.282346:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.282352:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1787432928.282354:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006b8984e/0xca72b3b3356409f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.282355:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.282359:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.282368:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.282370:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.282371:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.282373:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432928.282376:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.282383:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.282397:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432928.282458:0:25337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432928.282464:0:25337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.282472:0:25337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775a00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.282475:0:25337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.282484:0:25337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.282495:0:25337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787432928.282719:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.282725:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b335640a05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.282738:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.282740:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.282745:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b335640a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.282754:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b335640a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.282763:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b335640a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.282771:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b335640a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.282788:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432928.283099:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b3356409db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.283126:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b3356409db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.283145:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b3356409db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.283161:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432928.283178:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b335640a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.283185:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774c00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432928.283188:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b335640a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.283196:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b335640a05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.283206:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b335640a05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.283214:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f378938b/0xca72b3b335640a05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.283225:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432928.283226:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432928.283228:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432928.283437:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.283443:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b335640a0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.283452:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.283456:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.283460:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b335640a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.283470:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b335640a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.283489:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b335640a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.283496:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b335640a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.283516:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432928.283748:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432928.283753:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b335640a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.283765:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774e00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432928.283769:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b335640a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.283777:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b335640a0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.283789:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b335640a0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.283797:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033109a08/0xca72b3b335640a0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.283867:0:25337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000efd8c34/0xca72b3b3356409fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.283899:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.283903:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.283904:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.283906:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432928.283987:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432928.283989:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432928.283991:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432928.284322:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432928.284329:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001965f285/0xca72b3b335640a13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.284340:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1787432928.284344:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432928.284349:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001965f285/0xca72b3b335640a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.284368:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001965f285/0xca72b3b335640a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.284378:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001965f285/0xca72b3b335640a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.284385:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001965f285/0xca72b3b335640a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.284405:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432928.284413:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432928.284418:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001965f285/0xca72b3b335640a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.284425:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f600 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.284428:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001965f285/0xca72b3b335640a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.284436:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001965f285/0xca72b3b335640a13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.284447:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001965f285/0xca72b3b335640a13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.284455:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001965f285/0xca72b3b335640a13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.284479:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.284481:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.284482:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432928.285561:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432928.285572:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b335640a1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.285717:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1787432928.285722:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432928.285728:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b335640a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.285741:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b335640a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.285750:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b335640a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.285759:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b335640a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.285780:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432928.285795:0:25337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432928.285803:0:25337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b335640a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.285813:0:25337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fa00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432928.285817:0:25337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b335640a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.286692:0:25337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b335640a1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.286710:0:25337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b335640a1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.286719:0:25337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f98c0b8/0xca72b3b335640a1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.286742:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432928.286751:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432928.286753:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432928.287803:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432928.287814:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b335640a21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.287841:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1787432928.287845:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432928.287853:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b335640a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.287864:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b335640a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.287874:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b335640a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.287881:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b335640a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.287919:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432928.288184:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432928.288261:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b335640a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432928.288271:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302690c00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432928.288275:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b335640a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432928.288362:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b335640a21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432928.288385:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b335640a21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432928.288392:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b335640a21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432928.288413:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432928.288415:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432928.288417:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432928.292572:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432928.292601:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004871696e/0xca72b3b335640a28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.292620:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1787432928.292625:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432928.292632:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004871696e/0xca72b3b335640a28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.292657:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004871696e/0xca72b3b335640a28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.292680:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004871696e/0xca72b3b335640a28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.292689:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004871696e/0xca72b3b335640a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.292709:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432928.292723:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432928.292729:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004871696e/0xca72b3b335640a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.292736:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302690000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432928.292741:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004871696e/0xca72b3b335640a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.292750:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004871696e/0xca72b3b335640a28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.292769:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004871696e/0xca72b3b335640a28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.292777:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004871696e/0xca72b3b335640a28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.292797:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.292805:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432928.292807:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432928.296492:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.296506:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b335640a2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.296524:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.296530:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.296538:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b335640a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.296553:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b335640a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.296564:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b335640a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.296572:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b335640a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.296591:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432928.296766:0:25337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432928.296773:0:25337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b335640a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.296782:0:25337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432928.296787:0:25337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b335640a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.296808:0:25337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b335640a2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.297027:0:25337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b335640a2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.297036:0:25337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b0382aa/0xca72b3b335640a2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.297057:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432928.297059:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432928.297061:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432928.297421:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432928.297428:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640a36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.297437:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1787432928.297441:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432928.297446:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640a36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.297457:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640a36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.297466:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640a36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.297479:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.297500:0:24227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432928.297516:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432928.297522:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432928.297531:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775e00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432928.297535:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432928.297549:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640a36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432928.297562:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640a36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432928.297568:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec4631c1/0xca72b3b335640a36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432928.297583:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432928.297585:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432928.297586:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787432928.299911:0:24227:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:1.0:1787432928.300033:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22746:x1874258609573376:12345-0@lo:5:osp-pre-1-0.0 Request processed in 90421us (90703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432928.300045:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787432928.300397:0:22746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22746:1874258609573376:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787432928.300415:0:22746:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1787432928.300460:0:22746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22746:1874258609574016:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787432928.300505:0:22746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432928.300526:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830316b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432928.303001:0:25334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609574016 00000100:00100000:1.0:1787432928.303022:0:25334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609574016 00000100:00100000:1.0:1787432928.303097:0:25334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787432928.303109:0:25334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22746:x1874258609574016:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787432928.303191:0:25334:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000001:00080000:2.0:1787432928.305145:0:25040:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1787432928.305230:0:25040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787432928.305236:0:25040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787432928.305471:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23464:x1874258609573888:12345-0@lo:5:osp-pre-1-1.0 Request processed in 78703us (78750us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787432928.305481:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787432928.305532:0:23464:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1787432928.305540:0:23464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483036e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23464:1874258609573888:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787432928.305558:0:23464:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1787432928.305607:0:23464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23464:1874258609574144:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787432928.305644:0:23464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432928.305663:0:23464:0:(client.c:2715:ptlrpc_set_wait()) set ffff948402be6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787432928.305732:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609574144 00000100:00100000:2.0:1787432928.305738:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609574144 00000100:00100000:2.0:1787432928.305781:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787432928.305791:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23464:x1874258609574144:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787432928.305974:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23464:x1874258609574144:12345-0@lo:900:osp-pre-1-1.0 Request processed in 185us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432928.305982:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787432928.306013:0:23464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830456b480 x1874258609574144/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787432944 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432928.306024:0:23464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23464:1874258609574144:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787432928.308798:0:25334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22746:x1874258609574016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5683us (8284us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787432928.313214:0:25334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787432928.313404:0:22746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22746:1874258609574016:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787432928.313422:0:22746:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1787432928.397298:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787432929.298083:0:25397:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787432929.421509:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787432930.246510:0:25449:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432930.246737:0:25449:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787432930.252313:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432930.252348:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609574272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432930.252434:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432930.252594:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609574272 00000100:00100000:1.0:1787432930.252602:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609574272 00000100:00100000:1.0:1787432930.252676:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432930.252687:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609574272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787432930.252716:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787432930.252770:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609574272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432930.252778:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787432930.252846:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432930.252887:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609574272:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787432930.443608:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787432931.226929:0:25499:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787432931.227417:0:25499:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787432931.275433:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432931.275462:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483036e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609574400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432931.275577:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432931.275801:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432931.275810:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609574528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432931.275840:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432931.275952:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609574400 00000100:00100000:0.0:1787432931.275960:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609574400 00000100:00100000:0.0:1787432931.276016:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609574528 00000100:00100000:0.0:1787432931.276019:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609574528 00000100:00100000:0.0:1787432931.276036:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787432931.276045:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609574400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432931.276093:0:22724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787432931.276094:0:23798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787432931.276104:0:23798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609574528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432931.276122:0:23798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787432931.276156:0:23798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609574528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.276156:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609574400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432931.276183:0:23798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787432931.276235:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609574528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432931.277760:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787432931.277773:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483036e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609574400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432931.440125:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432931.440371:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588486400 00000100:00100000:2.0:1787432931.440385:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588486400 00000100:00100000:2.0:1787432931.440440:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 113 00000100:00100000:2.0:1787432931.440449:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b141450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2399:x1874258588486400:12345-192.168.204.24@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787432931.440478:0:22714:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e17f28a9-e09d-421e-8a64-93305d5e5e85@192.168.204.24@tcp t0 exp 0000000000000000 cur 742 last 0 00000020:00000080:2.0:1787432931.440512:0:22714:0:(genops.c:1385:class_connect()) connect: client e17f28a9-e09d-421e-8a64-93305d5e5e85, cookie 0xca72b3b335640a3d 00000100:00080000:2.0:1787432931.440646:0:22714:0:(import.c:65:import_set_state_nolock()) ffff948301dae800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432931.440873:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b141450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+5:2399:x1874258588486400:12345-192.168.204.24@tcp:250:mount.lustre.0 Request processed in 423us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432931.440882:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 113 00000100:00100000:0.0:1787432931.455714:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432931.455810:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588486528 00000100:00100000:1.0:1787432931.455822:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588486528 00000100:00100000:1.0:1787432931.455882:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 114 00000100:00100000:1.0:1787432931.455894:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b140050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+5:18096:x1874258588486528:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787432931.455911:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432931.455928:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302774400/0xca72b3b335640a44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d52e7 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.455956:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302774400/0xca72b3b335640a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52e7 expref: 6 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.455968:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302774400/0xca72b3b335640a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52e7 expref: 6 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.455987:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302774400, rc 0) 00000100:00100000:1.0:1787432931.456275:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b140050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+6:18096:x1874258588486528:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 381us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.456283:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 114 00000100:00100000:2.0:1787432931.462366:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432931.462715:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588486656 00000100:00100000:0.0:1787432931.462725:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588486656 00000100:00100000:0.0:1787432931.462787:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 115 00000100:00100000:0.0:1787432931.462799:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b143850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+6:18096:x1874258588486656:12345-192.168.204.24@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787432931.462932:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b143850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+6:18096:x1874258588486656:12345-192.168.204.24@tcp:501:mount.lustre.0 Request processed in 136us (574us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787432931.462941:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 115 00010000:00010000:0.0:1787432931.467506:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432931.471141:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432931.471393:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588486784 00000100:00100000:1.0:1787432931.471403:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588486784 00000100:00100000:1.0:1787432931.471460:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 116 00000100:00100000:1.0:1787432931.471471:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+6:18096:x1874258588486784:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787432931.471488:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432931.471519:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302775e00/0xca72b3b335640a4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d52ee expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.471547:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302775e00/0xca72b3b335640a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52ee expref: 7 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.471569:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302775e00/0xca72b3b335640a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52ee expref: 7 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.471578:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302775e00, rc 0) 00000100:00100000:1.0:1787432931.472448:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+7:18096:x1874258588486784:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 974us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.472458:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 116 00000100:00100000:1.0:1787432931.476807:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432931.479090:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588486912 00000100:00100000:2.0:1787432931.479105:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588486912 00000100:00100000:2.0:1787432931.479231:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 117 00000100:00100000:2.0:1787432931.479243:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b141050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+7:18096:x1874258588486912:12345-192.168.204.24@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787432931.479418:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b141050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+8:18096:x1874258588486912:12345-192.168.204.24@tcp:501:mount.lustre.0 Request processed in 177us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432931.479426:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 117 00000100:00100000:2.0:1787432931.483538:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432931.483637:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588487040 00000100:00100000:1.0:1787432931.483645:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588487040 00000100:00100000:1.0:1787432931.483701:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 118 00000100:00100000:1.0:1787432931.483712:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b142c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+8:18096:x1874258588487040:12345-192.168.204.24@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787432931.483873:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b142c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+8:18096:x1874258588487040:12345-192.168.204.24@tcp:503:mount.lustre.0 Request processed in 162us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.483882:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 118 00000100:00100000:3.0:1787432931.488776:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432931.488890:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588487168 00000100:00100000:0.0:1787432931.488900:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588487168 00000100:00100000:0.0:1787432931.489026:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 119 00000100:00100000:0.0:1787432931.489037:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b140c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+8:18114:x1874258588487168:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787432931.489230:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b140c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+8:18114:x1874258588487168:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 193us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.489238:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 119 00000100:00100000:0.0:1787432931.512335:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432931.512438:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588487296 00000100:00100000:2.0:1787432931.512449:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588487296 00000100:00100000:2.0:1787432931.512512:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 120 00000100:00100000:2.0:1787432931.512526:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+8:18114:x1874258588487296:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787432931.512832:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+8:18114:x1874258588487296:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 310us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432931.512842:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 120 00000100:00100000:2.0:1787432931.519584:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432931.519901:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588487424 00000100:00100000:1.0:1787432931.519912:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588487424 00000100:00100000:1.0:1787432931.520077:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 121 00000100:00100000:1.0:1787432931.520088:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843b143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+8:18114:x1874258588487424:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787432931.520291:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843b143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+8:18114:x1874258588487424:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 205us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.520319:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 121 00000100:00100000:3.0:1787432931.531303:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432931.531471:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588487552 00000100:00100000:2.0:1787432931.531481:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588487552 00000100:00100000:2.0:1787432931.531554:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 122 00000100:00100000:2.0:1787432931.531565:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843daa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+8:18096:x1874258588487552:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787432931.531584:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432931.531602:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948301f05c00/0xca72b3b335640a52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d531f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.531633:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948301f05c00/0xca72b3b335640a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d531f expref: 9 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.531644:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948301f05c00/0xca72b3b335640a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d531f expref: 9 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.531666:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f05c00, rc 0) 00000100:00100000:2.0:1787432931.531726:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843daa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+9:18096:x1874258588487552:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 162us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432931.531733:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 122 00000100:00100000:2.0:1787432931.534331:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432931.534410:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588487680 00000100:00100000:1.0:1787432931.534419:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588487680 00000100:00100000:1.0:1787432931.534492:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 123 00000100:00100000:1.0:1787432931.534502:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843daa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+9:18096:x1874258588487680:12345-192.168.204.24@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787432931.534521:0:22712:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787432931.534541:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787432931.534555:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787432931.534559:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787432931.534562:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787432931.534565:0:22712:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787432931.537286:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843daa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+9:18096:x1874258588487680:12345-192.168.204.24@tcp:256:mount.lustre.0 Request processed in 2773us (2950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.537301:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 123 00000100:00100000:3.0:1787432931.542153:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432931.542323:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588487808 00000100:00100000:0.0:1787432931.542334:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588487808 00000100:00100000:0.0:1787432931.542384:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 124 00000100:00100000:0.0:1787432931.542394:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843daa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+9:18096:x1874258588487808:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787432931.542413:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432931.542432:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948301edbc00/0xca72b3b335640a59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5326 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.542468:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948301edbc00/0xca72b3b335640a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5326 expref: 10 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.542480:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948301edbc00/0xca72b3b335640a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5326 expref: 10 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.542489:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301edbc00, rc 0) 00000100:00100000:0.0:1787432931.542552:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843daa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+10:18096:x1874258588487808:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 158us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.542559:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 124 00000100:00100000:0.0:1787432931.545308:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432931.545401:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588487936 00000100:00100000:2.0:1787432931.545410:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588487936 00000100:00100000:2.0:1787432931.545466:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 125 00000100:00100000:2.0:1787432931.545477:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843daa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+10:18096:x1874258588487936:12345-192.168.204.24@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787432931.545639:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843daa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+10:18096:x1874258588487936:12345-192.168.204.24@tcp:501:mount.lustre.0 Request processed in 163us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432931.545647:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 125 00000100:00100000:3.0:1787432931.553607:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432931.554396:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588488064 00000100:00100000:1.0:1787432931.554407:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588488064 00000100:00100000:1.0:1787432931.554468:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 126 00000100:00100000:1.0:1787432931.554480:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843daa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+10:18096:x1874258588488064:12345-192.168.204.24@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787432931.554638:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843daa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+10:18096:x1874258588488064:12345-192.168.204.24@tcp:503:mount.lustre.0 Request processed in 160us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.554646:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 126 00000100:00100000:3.0:1787432931.557229:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432931.557459:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588488192 00000100:00100000:0.0:1787432931.557470:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588488192 00000100:00100000:0.0:1787432931.557534:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 127 00000100:00100000:0.0:1787432931.557546:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843daa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+10:18119:x1874258588488192:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787432931.557711:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843daa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+10:18119:x1874258588488192:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 166us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.557720:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 127 00000100:00100000:0.0:1787432931.560792:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432931.560928:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588488320 00000100:00100000:2.0:1787432931.560952:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588488320 00000100:00100000:2.0:1787432931.561021:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 128 00000100:00100000:2.0:1787432931.561033:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+10:18119:x1874258588488320:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787432931.561248:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+10:18119:x1874258588488320:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 216us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432931.561258:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 128 00000100:00100000:3.0:1787432931.580269:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432931.580363:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432931.580644:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588488448 00000100:00100000:1.0:1787432931.580656:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588488448 00000100:00100000:1.0:1787432931.580709:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588488704 00000100:00100000:1.0:1787432931.580712:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588488704 00000100:00100000:1.0:1787432931.580736:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:1.0:1787432931.580753:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1874258588488448:12345-192.168.204.24@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787432931.580800:0:23799:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 454691f5-94b0-49cf-b719-d8e9565d245e@192.168.204.24@tcp t0 exp 0000000000000000 cur 742 last 0 00000020:00000080:1.0:1787432931.580849:0:23799:0:(genops.c:1385:class_connect()) connect: client 454691f5-94b0-49cf-b719-d8e9565d245e, cookie 0xca72b3b335640a60 00000004:00100000:1.0:1787432931.580873:0:23799:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787432931.581070:0:23799:0:(import.c:65:import_set_state_nolock()) ffff94841d29c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432931.581132:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+6:2399:x1874258588488448:12345-192.168.204.24@tcp:38:mount.lustre.0 Request processed in 387us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.581140:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:1.0:1787432931.581155:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:1.0:1787432931.581160:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1874258588488704:12345-192.168.204.24@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787432931.581196:0:23799:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 454691f5-94b0-49cf-b719-d8e9565d245e@192.168.204.24@tcp t0 exp 0000000000000000 cur 742 last 0 00000020:00000080:1.0:1787432931.581224:0:23799:0:(genops.c:1385:class_connect()) connect: client 454691f5-94b0-49cf-b719-d8e9565d245e, cookie 0xca72b3b335640a67 00000004:00100000:1.0:1787432931.581235:0:23799:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787432931.581358:0:23799:0:(import.c:65:import_set_state_nolock()) ffff94841d29d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432931.581380:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+6:2399:x1874258588488704:12345-192.168.204.24@tcp:38:mount.lustre.0 Request processed in 219us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.581386:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:3.0:1787432931.594146:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432931.594219:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432931.594247:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432931.594348:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588488832 00000100:00100000:0.0:1787432931.594359:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588488832 00000100:00100000:0.0:1787432931.594457:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588488960 00000100:00100000:0.0:1787432931.594461:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588488960 00000100:00100000:0.0:1787432931.594478:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588488576 00000100:00100000:0.0:1787432931.594481:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588488576 00000100:00100000:0.0:1787432931.594498:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:0.0:1787432931.594509:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+6:0:x1874258588488832:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787432931.594549:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787432931.594649:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+6:0:x1874258588488832:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 142us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.594656:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:0.0:1787432931.594673:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00100000:0.0:1787432931.594681:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+7:18096:x1874258588488960:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787432931.594693:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787432931.594730:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+7:18096:x1874258588488960:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 49us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.594736:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00080000:3.0:1787432931.594842:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432931.594847:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432931.595137:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 11 00000100:00100000:0.0:1787432931.595147:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+6:0:x1874258588488576:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787432931.595159:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787432931.595219:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+6:0:x1874258588488576:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 74us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.595226:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 11 00000100:00100000:3.0:1787432931.607113:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432931.607398:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588489088 00000100:00100000:0.0:1787432931.607436:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588489088 00000100:00100000:0.0:1787432931.607516:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:0.0:1787432931.607528:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+6:18096:x1874258588489088:12345-192.168.204.24@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787432931.607619:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+6:18096:x1874258588489088:12345-192.168.204.24@tcp:40:mount.lustre.0 Request processed in 93us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.607627:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:3.0:1787432931.617257:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432931.617848:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588489216 00000100:00100000:1.0:1787432931.617862:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588489216 00000100:00100000:1.0:1787432931.617921:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:1.0:1787432931.617931:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1874258588489216:12345-192.168.204.24@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787432931.617975:0:24227:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 454691f5-94b0-49cf-b719-d8e9565d245e@192.168.204.24@tcp t0 exp 0000000000000000 cur 742 last 0 00000020:00000080:1.0:1787432931.618015:0:24227:0:(genops.c:1385:class_connect()) connect: client 454691f5-94b0-49cf-b719-d8e9565d245e, cookie 0xca72b3b335640a6e 00002000:00100000:1.0:1787432931.618028:0:24227:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 454691f5-94b0-49cf-b719-d8e9565d245e/ffff948301e42800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787432931.618038:0:24227:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787432931.618532:0:24227:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787432931.618583:0:24227:0:(import.c:65:import_set_state_nolock()) ffff948301e46000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432931.618717:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:454691f5-94b0-49cf-b719-d8e9565d245e+6:2399:x1874258588489216:12345-192.168.204.24@tcp:8:mount.lustre.0 Request processed in 785us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.618727:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:2.0:1787432931.627493:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432931.627704:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432931.628232:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588489472 00000100:00100000:1.0:1787432931.628243:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588489472 00000100:00100000:1.0:1787432931.628311:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:1.0:1787432931.628323:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:454691f5-94b0-49cf-b719-d8e9565d245e+6:18096:x1874258588489472:12345-192.168.204.24@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787432931.628405:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:454691f5-94b0-49cf-b719-d8e9565d245e+6:18096:x1874258588489472:12345-192.168.204.24@tcp:900:mount.lustre.0 Request processed in 84us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.628414:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:0.0:1787432931.631239:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588489344 00000100:00100000:0.0:1787432931.631254:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588489344 00000100:00100000:0.0:1787432931.631351:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:0.0:1787432931.631359:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1874258588489344:12345-192.168.204.24@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787432931.631396:0:24225:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 454691f5-94b0-49cf-b719-d8e9565d245e@192.168.204.24@tcp t0 exp 0000000000000000 cur 742 last 0 00000020:00000080:0.0:1787432931.631428:0:24225:0:(genops.c:1385:class_connect()) connect: client 454691f5-94b0-49cf-b719-d8e9565d245e, cookie 0xca72b3b335640a75 00002000:00100000:0.0:1787432931.631440:0:24225:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 454691f5-94b0-49cf-b719-d8e9565d245e/ffff9483032ea800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787432931.631457:0:24225:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787432931.631615:0:24225:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787432931.631649:0:24225:0:(import.c:65:import_set_state_nolock()) ffff9484337c0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432931.631722:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:454691f5-94b0-49cf-b719-d8e9565d245e+6:2399:x1874258588489344:12345-192.168.204.24@tcp:8:mount.lustre.0 Request processed in 362us (4238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.631731:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:2.0:1787432931.635765:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432931.638929:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588489600 00000100:00100000:3.0:1787432931.638946:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588489600 00000100:00100000:3.0:1787432931.639185:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:3.0:1787432931.639200:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:454691f5-94b0-49cf-b719-d8e9565d245e+6:18096:x1874258588489600:12345-192.168.204.24@tcp:33:mount.lustre.0 00000100:00100000:1.0:1787432931.639200:0:22722:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1787432931.639214:0:22722:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00080000:3.0:1787432931.640858:0:22721:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1378us 00000004:00200000:1.0:1787432931.675777:0:22721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787432931.675953:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:454691f5-94b0-49cf-b719-d8e9565d245e+6:18096:x1874258588489600:12345-192.168.204.24@tcp:33:mount.lustre.0 Request processed in 36751us (40205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.675964:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:3.0:1787432931.885107:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432931.885213:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588489728 00000100:00100000:2.0:1787432931.885223:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588489728 00000100:00100000:2.0:1787432931.885301:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00100000:2.0:1787432931.885312:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+6:18142:x1874258588489728:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:2.0:1787432931.885333:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432931.885362:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640a7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5357 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.885424:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640a83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.885437:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640a83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.885451:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640a83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432931.885500:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787432931.885504:0:22718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432931.885538:0:22718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640a83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.885566:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640a7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5357 expref: 8 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.885584:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640a83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5357 expref: 7 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.885591:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766900) 00010000:00010000:2.0:1787432931.885594:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432931.885598:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f05400, rc 0) 00000100:00100000:2.0:1787432931.885659:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+7:18142:x1874258588489728:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 349us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432931.885672:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 13 00010000:00010000:3.0:1787432932.494129:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432933.323688:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432933.323715:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609574656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432933.323805:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432933.323851:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609574656 00000100:00100000:0.0:1787432933.323859:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609574656 00000100:00100000:3.0:1787432933.323883:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432933.323892:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483036e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609574784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432933.323918:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432933.323926:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432933.323941:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609574656:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787432933.323944:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787432933.324061:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787432933.324069:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a13c04c-dd5b-4f06-b031-814868f35d81:3642:1874258609574912:0@lo:400:kworker.0 00000100:00100000:1.0:1787432933.324158:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609575296:0@lo:400:kworker.0 00000100:00100000:2.0:1787432933.324237:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609575168:0@lo:400:kworker.0 00000100:00100000:3.0:1787432933.324286:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432933.324312:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609575424:0@lo:400:kworker.0 00000100:00100000:3.0:1787432933.324343:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432933.324377:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609575936:0@lo:400:kworker.0 00000100:00100000:2.0:1787432933.324396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432933.324418:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609575424 00000100:00100000:3.0:1787432933.324423:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609575424 00000100:00100000:2.0:1787432933.324430:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609575680:0@lo:400:kworker.0 00000100:00100000:2.0:1787432933.324460:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432933.324468:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432933.324477:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609575424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432933.324482:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609576192:0@lo:400:kworker.0 00000100:00100000:2.0:1787432933.324521:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432933.324529:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609575424:12345-0@lo:400:kworker.0 Request processed in 53us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432933.324537:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787432933.324544:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787432933.324551:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609575040:0@lo:400:kworker.0 00000100:00100000:2.0:1787432933.324655:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432933.324677:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609575552:0@lo:400:kworker.0 00000100:00100000:2.0:1787432933.324702:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432933.324723:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609575552 00000100:00100000:2.0:1787432933.324724:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609576064:0@lo:400:kworker.0 00000100:00100000:3.0:1787432933.324729:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609575552 00000100:00100000:2.0:1787432933.324757:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432933.324763:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432933.324773:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609575552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432933.324819:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609575168 00000100:00100000:3.0:1787432933.324820:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609575552:12345-0@lo:400:kworker.0 Request processed in 48us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432933.324824:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609575168 00000100:00100000:3.0:1787432933.324830:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787432933.324854:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609575680 00000100:00080000:3.0:1787432933.324856:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432933.324858:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609575680 00000100:00080000:3.0:1787432933.324863:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432933.324875:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609576192 00000100:00100000:2.0:1787432933.324878:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609576192 00000100:00100000:2.0:1787432933.324902:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609576064 00000100:00100000:3.0:1787432933.324903:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609574656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432933.324906:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609576064 00000100:00100000:2.0:1787432933.324926:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787432933.324932:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432933.324936:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609575168:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787432933.324938:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432933.324951:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432933.325142:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609575424:0@lo:400:kworker.0 00000100:00100000:3.0:1787432933.325153:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432933.325157:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609575168:12345-0@lo:400:kworker.0 Request processed in 222us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432933.325183:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609576320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432933.325200:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787432933.325215:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432933.325217:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609575936 00000100:00100000:2.0:1787432933.325222:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609575936 00000100:00080000:3.0:1787432933.325245:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432933.325273:0:23798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609575040 00000100:00100000:3.0:1787432933.325282:0:23798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609575040 00000100:00100000:3.0:1787432933.325309:0:23798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787432933.325315:0:23798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609575040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432933.325347:0:23798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609575040:12345-0@lo:400:kworker.0 Request processed in 32us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432933.325353:0:23798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787432933.325485:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609574656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1548us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432933.325499:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432933.325519:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609574784 00000100:00100000:0.0:1787432933.325523:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609574784 00000100:00100000:0.0:1787432933.325546:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609576320 00000100:00100000:0.0:1787432933.325548:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609576320 00000100:00100000:0.0:1787432933.325560:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787432933.325565:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874258609574784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787432933.325596:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787432933.325636:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874258609574784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432933.325642:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787432933.325653:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787432933.325660:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609576320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787432933.325670:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787432933.325706:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609576320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432933.325715:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787432933.325735:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432933.325753:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787432933.325765:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609575680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432933.325797:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609575680:12345-0@lo:400:kworker.0 Request processed in 38us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432933.325803:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787432933.325817:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787432933.325823:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609576192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432933.325873:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609576192:12345-0@lo:400:kworker.0 Request processed in 50us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432933.325885:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787432933.325898:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787432933.325903:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609576064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432933.325933:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609576064:12345-0@lo:400:kworker.0 Request processed in 30us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432933.325938:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787432933.325949:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787432933.325955:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609575936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432933.326502:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609576320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432933.326520:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483036e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609574784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432933.326757:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609575040:0@lo:400:kworker.0 00000100:00100000:3.0:1787432933.326768:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609575552:0@lo:400:kworker.0 00000100:00100000:3.0:1787432933.326798:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609576064:0@lo:400:kworker.0 00000100:00100000:3.0:1787432933.326814:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609575168:0@lo:400:kworker.0 00000100:00100000:3.0:1787432933.326828:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609575680:0@lo:400:kworker.0 00010000:00080000:3.0:1787432933.326845:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359e9f80 x1874258609576192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432933.326855:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609576192:0@lo:400:kworker.0 00000100:00100000:3.0:1787432933.326898:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609574912 00000100:00100000:3.0:1787432933.326904:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609574912 00000100:00100000:3.0:1787432933.326944:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787432933.326951:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:3642:x1874258609574912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432933.327205:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:3642:x1874258609574912:12345-0@lo:400:kworker.0 Request processed in 253us (2919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432933.327221:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787432933.327264:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a13c04c-dd5b-4f06-b031-814868f35d81:3642:1874258609574912:0@lo:400:kworker.0 00000100:00100000:1.0:1787432933.327914:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432933.327926:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609575936:12345-0@lo:400:kworker.0 Request processed in 1967us (2971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432933.327936:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787432933.327956:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609575808:0@lo:400:kworker.0 00000100:00100000:0.0:1787432933.327970:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609575296 00000100:00100000:0.0:1787432933.327975:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609575296 00000100:00100000:1.0:1787432933.328005:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432933.328015:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787432933.328042:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609575296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432933.328054:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609575808 00000100:00100000:1.0:1787432933.328059:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609575808 00000100:00100000:0.0:1787432933.328098:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609575296:12345-0@lo:400:kworker.0 Request processed in 57us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432933.328105:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787432933.328108:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787432933.328117:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609575808:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787432933.328129:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432933.328189:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609575808:12345-0@lo:400:kworker.0 Request processed in 74us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432933.328197:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787432933.328197:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609575296:0@lo:400:kworker.0 00000100:00100000:0.0:1787432933.328218:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609575808:0@lo:400:kworker.0 00010000:00080000:3.0:1787432933.330754:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359ead80 x1874258609575936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432933.330785:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609575936:0@lo:400:kworker.0 00010000:00010000:0.0:1787432933.516048:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787432933.839244:0:25040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 454691f5-94b0-49cf-b719-d8e9565d245e 00000001:00080000:2.0:1787432933.839261:0:25040:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:3.0:1787432933.890581:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432933.891068:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588489856 00000100:00100000:0.0:1787432933.891079:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588489856 00000100:00100000:0.0:1787432933.891201:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:0.0:1787432933.891227:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+7:18194:x1874258588489856:12345-192.168.204.24@tcp:41:lfs.0 00000004:00000024:0.0:1787432933.891265:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787432933.891356:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+7:18194:x1874258588489856:12345-192.168.204.24@tcp:41:lfs.0 Request processed in 134us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432933.891364:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00080000:2.0:1787432933.891853:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432933.894709:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432933.895004:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588489984 00000100:00100000:1.0:1787432933.895038:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588489984 00000100:00100000:1.0:1787432933.895126:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:1.0:1787432933.895138:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+6:18194:x1874258588489984:12345-192.168.204.24@tcp:41:lfs.0 00000004:00000024:1.0:1787432933.895208:0:23799:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787432933.895300:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+6:18194:x1874258588489984:12345-192.168.204.24@tcp:41:lfs.0 Request processed in 164us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432933.895309:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00080000:2.0:1787432933.895384:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432933.901346:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432933.901806:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588490112 00000100:00100000:0.0:1787432933.901817:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588490112 00000100:00100000:0.0:1787432933.901906:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:0.0:1787432933.901918:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:454691f5-94b0-49cf-b719-d8e9565d245e+6:18194:x1874258588490112:12345-192.168.204.24@tcp:13:lfs.0 00002000:00000024:0.0:1787432933.901944:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787432933.902049:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:454691f5-94b0-49cf-b719-d8e9565d245e+6:18194:x1874258588490112:12345-192.168.204.24@tcp:13:lfs.0 Request processed in 132us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432933.902057:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00080000:2.0:1787432933.902816:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432933.907834:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432933.908124:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588490240 00000100:00100000:0.0:1787432933.908136:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588490240 00000100:00100000:0.0:1787432933.908249:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00100000:0.0:1787432933.908261:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:454691f5-94b0-49cf-b719-d8e9565d245e+5:18194:x1874258588490240:12345-192.168.204.24@tcp:13:lfs.0 00002000:00000024:0.0:1787432933.908287:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787432933.908381:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:454691f5-94b0-49cf-b719-d8e9565d245e+5:18194:x1874258588490240:12345-192.168.204.24@tcp:13:lfs.0 Request processed in 121us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432933.908389:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00080000:2.0:1787432933.908579:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432934.092690:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432934.093238:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588490368 00000100:00100000:0.0:1787432934.093249:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588490368 00000100:00100000:0.0:1787432934.093311:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 130 00000100:00100000:0.0:1787432934.093323:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+10:18228:x1874258588490368:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787432934.093484:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432934.093502:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948301eda200/0xca72b3b335640a8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d535e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432934.093532:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948301eda200/0xca72b3b335640a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d535e expref: 11 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432934.093543:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948301eda200/0xca72b3b335640a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d535e expref: 11 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432934.093551:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301eda200, rc 0) 00000100:00100000:0.0:1787432934.093622:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+11:18228:x1874258588490368:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 301us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432934.093630:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 130 00000100:00100000:3.0:1787432934.109610:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432934.109699:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588490496 00000100:00100000:2.0:1787432934.109711:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588490496 00000100:00100000:2.0:1787432934.109781:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 131 00000100:00100000:2.0:1787432934.109793:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+11:18228:x1874258588490496:12345-192.168.204.24@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787432934.109976:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+11:18228:x1874258588490496:12345-192.168.204.24@tcp:501:mount.lustre.0 Request processed in 184us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432934.109984:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 131 00000100:00100000:2.0:1787432934.116546:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432934.117850:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588490624 00000100:00100000:3.0:1787432934.117865:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588490624 00000100:00100000:3.0:1787432934.117942:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 132 00000100:00100000:3.0:1787432934.117955:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+11:18228:x1874258588490624:12345-192.168.204.24@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787432934.118150:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+11:18228:x1874258588490624:12345-192.168.204.24@tcp:503:mount.lustre.0 Request processed in 197us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432934.118160:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 132 00000100:00100000:3.0:1787432934.133040:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432934.133363:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588490752 00000100:00100000:0.0:1787432934.133376:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588490752 00000100:00100000:0.0:1787432934.133446:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 133 00000100:00100000:0.0:1787432934.133460:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+11:18232:x1874258588490752:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787432934.134361:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+11:18232:x1874258588490752:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 188us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432934.134371:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 133 00000100:00100000:0.0:1787432934.167876:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432934.167995:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588490880 00000100:00100000:2.0:1787432934.168016:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588490880 00000100:00100000:2.0:1787432934.168092:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 134 00000100:00100000:2.0:1787432934.168105:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+11:18232:x1874258588490880:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787432934.168315:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+11:18232:x1874258588490880:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 211us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432934.168325:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 134 00000100:00100000:2.0:1787432934.172803:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432934.172964:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588491008 00000100:00100000:0.0:1787432934.172975:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588491008 00000100:00100000:0.0:1787432934.173050:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 135 00000100:00100000:0.0:1787432934.173061:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+11:18232:x1874258588491008:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787432934.173255:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+11:18232:x1874258588491008:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 194us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432934.173264:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 135 00000100:00100000:0.0:1787432934.178808:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432934.181783:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588491136 00000100:00100000:3.0:1787432934.181800:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588491136 00000100:00100000:3.0:1787432934.181958:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 136 00000100:00100000:3.0:1787432934.181971:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+11:18228:x1874258588491136:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787432934.181989:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432934.182061:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302691400/0xca72b3b335640a91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d538f expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432934.182094:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302691400/0xca72b3b335640a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d538f expref: 12 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432934.182104:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302691400/0xca72b3b335640a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d538f expref: 12 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432934.182114:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302691400, rc 0) 00000100:00100000:3.0:1787432934.182201:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+12:18228:x1874258588491136:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 233us (3405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432934.182209:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 136 00000100:00100000:0.0:1787432934.189890:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432934.192756:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588491264 00000100:00100000:2.0:1787432934.192798:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588491264 00000100:00100000:2.0:1787432934.192877:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 137 00000100:00100000:2.0:1787432934.192889:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+12:18228:x1874258588491264:12345-192.168.204.24@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787432934.192920:0:22714:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787432934.193215:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787432934.193220:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787432934.193223:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787432934.193227:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787432934.193229:0:22714:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1787432934.202158:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+12:18228:x1874258588491264:12345-192.168.204.24@tcp:256:mount.lustre.0 Request processed in 9257us (12263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432934.202202:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 137 00000100:00100000:3.0:1787432934.206851:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432934.207057:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588491392 00000100:00100000:1.0:1787432934.207068:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588491392 00000100:00100000:1.0:1787432934.207200:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 138 00000100:00100000:1.0:1787432934.207212:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+12:18228:x1874258588491392:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787432934.207229:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432934.207256:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302774000/0xca72b3b335640a98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5396 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432934.207286:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302774000/0xca72b3b335640a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5396 expref: 13 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432934.207297:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302774000/0xca72b3b335640a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5396 expref: 13 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432934.207307:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302774000, rc 0) 00000100:00100000:1.0:1787432934.207419:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:18228:x1874258588491392:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 209us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432934.207441:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 138 00000100:00100000:1.0:1787432934.210492:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432934.210577:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588491520 00000100:00100000:3.0:1787432934.210586:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588491520 00000100:00100000:3.0:1787432934.210637:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 139 00000100:00100000:3.0:1787432934.210646:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:18228:x1874258588491520:12345-192.168.204.24@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787432934.210993:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:18228:x1874258588491520:12345-192.168.204.24@tcp:501:mount.lustre.0 Request processed in 346us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432934.211012:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 139 00000100:00100000:2.0:1787432934.213619:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432934.213820:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588491648 00000100:00100000:1.0:1787432934.213830:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588491648 00000100:00100000:1.0:1787432934.213886:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 140 00000100:00100000:1.0:1787432934.213897:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:18228:x1874258588491648:12345-192.168.204.24@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787432934.214064:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:18228:x1874258588491648:12345-192.168.204.24@tcp:503:mount.lustre.0 Request processed in 168us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432934.214072:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 140 00000100:00100000:0.0:1787432934.218214:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432934.218438:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588491776 00000100:00100000:3.0:1787432934.218448:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588491776 00000100:00100000:3.0:1787432934.218495:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 141 00000100:00100000:3.0:1787432934.218505:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:18238:x1874258588491776:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787432934.218686:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:18238:x1874258588491776:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 181us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432934.218701:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 141 00000100:00100000:3.0:1787432934.229605:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432934.229944:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588491904 00000100:00100000:0.0:1787432934.229956:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588491904 00000100:00100000:0.0:1787432934.230021:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 142 00000100:00100000:0.0:1787432934.230033:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:18238:x1874258588491904:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787432934.230941:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:18238:x1874258588491904:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 905us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432934.230952:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 142 00000100:00100000:2.0:1787432934.257813:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432934.257862:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432934.257893:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432934.257935:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432934.257962:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432934.257988:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432934.258044:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588492928 00000100:00100000:2.0:1787432934.258054:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588492928 00000100:00100000:2.0:1787432934.258105:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588493056 00000100:00100000:2.0:1787432934.258109:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588493056 00000100:00100000:2.0:1787432934.258129:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:2.0:1787432934.258139:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:454691f5-94b0-49cf-b719-d8e9565d245e+6:2401:x1874258588492928:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432934.258249:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:454691f5-94b0-49cf-b719-d8e9565d245e+6:2401:x1874258588492928:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 110us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432934.258257:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:2.0:1787432934.258274:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:2.0:1787432934.258281:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:454691f5-94b0-49cf-b719-d8e9565d245e+5:2401:x1874258588493056:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432934.258326:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:454691f5-94b0-49cf-b719-d8e9565d245e+5:2401:x1874258588493056:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 45us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432934.258333:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:2.0:1787432934.258361:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588492032 00000100:00100000:2.0:1787432934.258365:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588492032 00000100:00100000:2.0:1787432934.258378:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588492288 00000100:00100000:2.0:1787432934.258381:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588492288 00000100:00100000:2.0:1787432934.258387:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588492672 00000100:00100000:2.0:1787432934.258389:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588492672 00000100:00100000:2.0:1787432934.258405:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588492800 00000100:00100000:2.0:1787432934.258407:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588492800 00000100:00100000:2.0:1787432934.258420:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 36 00000100:00100000:2.0:1787432934.258426:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+7:2401:x1874258588492672:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432934.258456:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+7:2401:x1874258588492672:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432934.258462:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 36 00000100:00100000:2.0:1787432934.258474:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 37 00000100:00100000:2.0:1787432934.258480:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+6:2401:x1874258588492800:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432934.258504:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+6:2401:x1874258588492800:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432934.258509:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 37 00000100:00100000:2.0:1787432934.258520:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:2.0:1787432934.258525:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1874258588492032:12345-192.168.204.24@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787432934.258548:0:23799:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c1550083-39d1-481c-8177-f7494d742169@192.168.204.24@tcp t0 exp 0000000000000000 cur 745 last 0 00000020:00000080:2.0:1787432934.258586:0:23799:0:(genops.c:1385:class_connect()) connect: client c1550083-39d1-481c-8177-f7494d742169, cookie 0xca72b3b335640a9f 00000004:00100000:2.0:1787432934.258618:0:23799:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787432934.258712:0:23799:0:(import.c:65:import_set_state_nolock()) ffff948301daf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432934.258742:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1550083-39d1-481c-8177-f7494d742169+6:2399:x1874258588492032:12345-192.168.204.24@tcp:38:mount.lustre.0 Request processed in 216us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432934.258750:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:2.0:1787432934.258764:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:2.0:1787432934.258768:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1874258588492288:12345-192.168.204.24@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787432934.258784:0:23799:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c1550083-39d1-481c-8177-f7494d742169@192.168.204.24@tcp t0 exp 0000000000000000 cur 745 last 0 00000020:00000080:2.0:1787432934.258804:0:23799:0:(genops.c:1385:class_connect()) connect: client c1550083-39d1-481c-8177-f7494d742169, cookie 0xca72b3b335640aa6 00000004:00100000:2.0:1787432934.258816:0:23799:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787432934.258857:0:23799:0:(import.c:65:import_set_state_nolock()) ffff9483030ce000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432934.258880:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1550083-39d1-481c-8177-f7494d742169+6:2399:x1874258588492288:12345-192.168.204.24@tcp:38:mount.lustre.0 Request processed in 111us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432934.258887:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:3.0:1787432934.261907:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432934.261948:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432934.261979:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432934.262085:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588492544 00000100:00100000:1.0:1787432934.262094:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588492544 00000100:00100000:1.0:1787432934.262204:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588492416 00000100:00100000:1.0:1787432934.262207:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588492416 00000100:00100000:1.0:1787432934.262223:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588492160 00000100:00100000:1.0:1787432934.262225:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588492160 00000100:00100000:1.0:1787432934.262247:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:1.0:1787432934.262258:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1550083-39d1-481c-8177-f7494d742169+7:18228:x1874258588492544:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787432934.262301:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787432934.262372:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1550083-39d1-481c-8177-f7494d742169+7:18228:x1874258588492544:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 115us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432934.262381:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:1.0:1787432934.262398:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:1.0:1787432934.262405:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1550083-39d1-481c-8177-f7494d742169+6:0:x1874258588492416:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787432934.262422:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787432934.262457:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1550083-39d1-481c-8177-f7494d742169+6:0:x1874258588492416:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 52us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432934.262478:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:1.0:1787432934.262493:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:1.0:1787432934.262500:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1550083-39d1-481c-8177-f7494d742169+6:0:x1874258588492160:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787432934.262510:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787432934.262533:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1550083-39d1-481c-8177-f7494d742169+6:0:x1874258588492160:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 34us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432934.262539:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00080000:3.0:1787432934.262851:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432934.262856:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432934.265431:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432934.265585:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588493184 00000100:00100000:1.0:1787432934.265594:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588493184 00000100:00100000:1.0:1787432934.265655:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:1.0:1787432934.265666:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1550083-39d1-481c-8177-f7494d742169+6:18228:x1874258588493184:12345-192.168.204.24@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787432934.265820:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1550083-39d1-481c-8177-f7494d742169+6:18228:x1874258588493184:12345-192.168.204.24@tcp:40:mount.lustre.0 Request processed in 155us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432934.265839:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:2.0:1787432934.283618:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432934.283661:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432934.283693:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432934.283978:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588493568 00000100:00100000:1.0:1787432934.283990:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588493568 00000100:00100000:1.0:1787432934.284062:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:1.0:1787432934.284072:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c1550083-39d1-481c-8177-f7494d742169+6:18228:x1874258588493568:12345-192.168.204.24@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787432934.284156:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c1550083-39d1-481c-8177-f7494d742169+6:18228:x1874258588493568:12345-192.168.204.24@tcp:900:mount.lustre.0 Request processed in 85us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432934.284201:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:3.0:1787432934.287158:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588493312 00000100:00100000:3.0:1787432934.287642:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588493312 00000100:00100000:1.0:1787432934.288034:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588493440 00000100:00100000:1.0:1787432934.288039:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588493440 00000100:00100000:1.0:1787432934.288074:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:1.0:1787432934.288084:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1874258588493312:12345-192.168.204.24@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787432934.288147:0:24228:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c1550083-39d1-481c-8177-f7494d742169@192.168.204.24@tcp t0 exp 0000000000000000 cur 745 last 0 00000020:00000080:1.0:1787432934.288330:0:24228:0:(genops.c:1385:class_connect()) connect: client c1550083-39d1-481c-8177-f7494d742169, cookie 0xca72b3b335640aad 00002000:00100000:1.0:1787432934.288345:0:24228:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c1550083-39d1-481c-8177-f7494d742169/ffff94843d623000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787432934.288357:0:24228:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787432934.288428:0:24228:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787432934.288461:0:24228:0:(import.c:65:import_set_state_nolock()) ffff94843d623800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432934.288605:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1550083-39d1-481c-8177-f7494d742169+6:2399:x1874258588493312:12345-192.168.204.24@tcp:8:mount.lustre.0 Request processed in 520us (4942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432934.288614:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:1.0:1787432934.288632:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:1.0:1787432934.288637:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1874258588493440:12345-192.168.204.24@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787432934.288730:0:24228:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c1550083-39d1-481c-8177-f7494d742169@192.168.204.24@tcp t0 exp 0000000000000000 cur 745 last 0 00000020:00000080:1.0:1787432934.288825:0:24228:0:(genops.c:1385:class_connect()) connect: client c1550083-39d1-481c-8177-f7494d742169, cookie 0xca72b3b335640ab4 00002000:00100000:1.0:1787432934.288832:0:24228:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c1550083-39d1-481c-8177-f7494d742169/ffff94843d620800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787432934.288839:0:24228:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787432934.288883:0:24228:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787432934.288898:0:24228:0:(import.c:65:import_set_state_nolock()) ffff94843d624000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432934.289016:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1550083-39d1-481c-8177-f7494d742169+6:2399:x1874258588493440:12345-192.168.204.24@tcp:8:mount.lustre.0 Request processed in 376us (5321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432934.289024:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:1.0:1787432934.295388:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432934.295542:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588493696 00000100:00100000:3.0:1787432934.295553:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588493696 00000100:00100000:3.0:1787432934.295611:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1 00000100:00100000:3.0:1787432934.295623:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1550083-39d1-481c-8177-f7494d742169+6:18228:x1874258588493696:12345-192.168.204.24@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787432934.295872:0:22722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787432934.295963:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1550083-39d1-481c-8177-f7494d742169+6:18228:x1874258588493696:12345-192.168.204.24@tcp:33:mount.lustre.0 Request processed in 342us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432934.295971:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1 00000100:00100000:2.0:1787432934.443287:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432934.443377:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588493824 00000100:00100000:0.0:1787432934.443388:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588493824 00000100:00100000:0.0:1787432934.443453:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:0.0:1787432934.443466:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1550083-39d1-481c-8177-f7494d742169+6:18261:x1874258588493824:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:0.0:1787432934.443490:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432934.443515:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640abb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d53c7 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432934.443581:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb000/0xca72b3b335640ac2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432934.443595:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb000/0xca72b3b335640ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432934.443624:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb000/0xca72b3b335640ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432934.443674:0:22720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787432934.443678:0:22720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787432934.443698:0:22720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb000/0xca72b3b335640ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432934.443724:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640abb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53c7 expref: 8 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432934.443742:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb000/0xca72b3b335640ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53c7 expref: 7 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432934.443751:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766900) 00010000:00010000:0.0:1787432934.443753:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787432934.443756:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301edb000, rc 0) 00000100:00100000:0.0:1787432934.443820:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1550083-39d1-481c-8177-f7494d742169+7:18261:x1874258588493824:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 358us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432934.443827:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 22 00010000:00010000:0.0:1787432934.540649:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787432934.988003:0:22754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787432935.372567:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609576448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432935.372634:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432935.372697:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609576448 00000100:00100000:1.0:1787432935.372705:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609576448 00000100:00100000:1.0:1787432935.372758:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432935.372768:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609576448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787432935.372796:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787432935.372839:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609576448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432935.372846:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787432935.372866:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432935.372900:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609576448:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787432935.570386:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432936.400486:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609576576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432936.400564:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432936.400630:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609576576 00000100:00100000:1.0:1787432936.400638:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609576576 00000100:00100000:1.0:1787432936.400701:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787432936.400714:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609576576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787432936.400757:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787432936.400809:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609576576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432936.400817:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787432936.400863:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609576576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432936.401478:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432936.401492:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483036e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609576704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432936.401536:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432936.401751:0:23798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609576704 00000100:00100000:0.0:1787432936.401758:0:23798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609576704 00000100:00100000:0.0:1787432936.401805:0:23798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787432936.401815:0:23798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609576704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432936.401841:0:23798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787432936.401905:0:23798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609576704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432936.401925:0:23798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787432936.402035:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483036e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609576704:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787432936.587363:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787432936.913080:0:22699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c1550083-39d1-481c-8177-f7494d742169 00000001:00100000:2.0:1787432936.913095:0:22699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 454691f5-94b0-49cf-b719-d8e9565d245e 00000001:00100000:1.0:1787432936.913269:0:23453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c1550083-39d1-481c-8177-f7494d742169 00000001:00100000:1.0:1787432936.913276:0:23453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 454691f5-94b0-49cf-b719-d8e9565d245e 00000001:02000400:2.0:1787432936.972856:0:25598:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:2.0:1787432937.486104:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787432937.611530:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787432937.936153:0:24222:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c1550083-39d1-481c-8177-f7494d742169 00000001:00100000:1.0:1787432937.936210:0:24222:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 454691f5-94b0-49cf-b719-d8e9565d245e 00000100:00100000:1.0:1787432938.443425:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609577216:0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.443485:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a13c04c-dd5b-4f06-b031-814868f35d81:3641:1874258609576832:0@lo:400:kworker.0 00000100:00100000:1.0:1787432938.443494:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432938.443517:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432938.443553:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609576960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432938.443554:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609577728:0@lo:400:kworker.0 00000100:00100000:0.0:1787432938.446257:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609576832 00000100:00100000:0.0:1787432938.446271:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609576832 00000100:00100000:0.0:1787432938.446324:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787432938.446335:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:3641:x1874258609576832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432938.446748:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609577344:0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.449345:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432938.449409:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609577472:0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.449463:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432938.449508:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609577984:0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.449534:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432938.449557:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609578496:0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.449578:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432938.449607:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787432938.449613:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609577088:0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.449637:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432938.449655:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609577600:0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.449673:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432938.449690:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405940a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609578112:0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.449708:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432938.449727:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609578624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432938.449748:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432938.449791:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609576960 00000100:00100000:3.0:1787432938.449799:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609576960 00000100:00100000:3.0:1787432938.449844:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609578624 00000100:00100000:3.0:1787432938.449848:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609578624 00000100:00100000:3.0:1787432938.449864:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787432938.449873:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609576960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432938.449902:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787432938.449963:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609576960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432938.449983:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787432938.450003:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787432938.450009:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609578624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787432938.450025:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787432938.450055:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609578624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432938.450061:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787432938.450080:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609577472 00000100:00100000:3.0:1787432938.450083:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609577472 00000100:00100000:3.0:1787432938.450108:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609577984 00000100:00100000:3.0:1787432938.450111:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609577984 00000100:00100000:3.0:1787432938.450121:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609578496 00000100:00100000:3.0:1787432938.450123:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609578496 00000100:00100000:3.0:1787432938.450135:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609578112 00000100:00100000:3.0:1787432938.450138:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609578112 00000100:00100000:3.0:1787432938.450151:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787432938.450157:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609577472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.451779:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609577472:12345-0@lo:400:kworker.0 Request processed in 57us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432938.451801:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787432938.451833:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787432938.451843:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609577984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.451911:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609577984:12345-0@lo:400:kworker.0 Request processed in 71us (2375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432938.451928:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787432938.451941:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787432938.451949:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609578496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.451995:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609578496:12345-0@lo:400:kworker.0 Request processed in 47us (2415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432938.452002:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787432938.452013:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787432938.452020:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609578112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.452046:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609578112:12345-0@lo:400:kworker.0 Request processed in 27us (2337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432938.452053:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787432938.452083:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609577088 00000100:00100000:3.0:1787432938.452089:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609577088 00000100:00100000:3.0:1787432938.452124:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609577600 00000100:00100000:3.0:1787432938.452127:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609577600 00000100:00100000:3.0:1787432938.452140:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787432938.452145:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609577088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.452255:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609577088:12345-0@lo:400:kworker.0 Request processed in 109us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432938.452263:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787432938.452276:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787432938.452283:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609577600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.452312:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609577600:12345-0@lo:400:kworker.0 Request processed in 30us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432938.452318:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787432938.452348:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432938.452353:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432938.452357:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432938.452361:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432938.452515:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609577088:0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.452539:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609577600:0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.452549:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405940a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609578112:0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.452567:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609578624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432938.452584:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609576960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432938.452597:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609577472:0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.452607:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609577984:0@lo:400:kworker.0 00010000:00080000:3.0:1787432938.452619:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405942a00 x1874258609578496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432938.452630:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609578496:0@lo:400:kworker.0 00000100:00100000:0.0:1787432938.453628:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:3641:x1874258609576832:12345-0@lo:400:kworker.0 Request processed in 7278us (10093us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432938.453650:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787432938.454018:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a13c04c-dd5b-4f06-b031-814868f35d81:3641:1874258609576832:0@lo:400:kworker.0 00000100:00100000:1.0:1787432938.454120:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432938.454183:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609578240:0@lo:400:kworker.0 00000100:00100000:1.0:1787432938.454220:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432938.454243:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483036e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609578752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432938.454265:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432938.454266:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432938.454284:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609577856:0@lo:400:kworker.0 00000100:00100000:1.0:1787432938.454293:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609577216 00000100:00100000:1.0:1787432938.454298:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609577216 00000100:00100000:2.0:1787432938.454320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432938.454437:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609578368:0@lo:400:kworker.0 00000100:00100000:2.0:1787432938.454461:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432938.454594:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609578752 00000100:00100000:3.0:1787432938.454599:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609578752 00000100:00100000:3.0:1787432938.454656:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787432938.454664:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609578752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432938.454683:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787432938.454726:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609578752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432938.454732:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787432938.454753:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432938.454763:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609578240 00000100:00100000:3.0:1787432938.454767:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609578240 00000100:00100000:3.0:1787432938.454793:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609578368 00000100:00100000:3.0:1787432938.454796:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609578368 00000100:00100000:3.0:1787432938.454827:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787432938.454834:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609578240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.454865:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609578240:12345-0@lo:400:kworker.0 Request processed in 32us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432938.454871:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787432938.454882:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787432938.454888:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609578368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.454928:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609578368:12345-0@lo:400:kworker.0 Request processed in 29us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432938.454934:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787432938.454951:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432938.454954:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432938.454971:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1787432938.454989:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483036e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609578752:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787432938.455003:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405942680 x1874258609578240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432938.455014:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609578240:0@lo:400:kworker.0 00000100:00100000:1.0:1787432938.455096:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609577728 00000100:00100000:1.0:1787432938.455101:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609577728 00000100:00100000:1.0:1787432938.455135:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609577344 00000100:00100000:1.0:1787432938.455139:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609577344 00000100:00100000:1.0:1787432938.455148:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609577856 00000100:00100000:1.0:1787432938.455150:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609577856 00000100:00100000:1.0:1787432938.455180:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787432938.455189:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609577216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432938.455230:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609577216:12345-0@lo:400:kworker.0 Request processed in 37us (11730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432938.455236:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787432938.455248:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787432938.455254:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609577728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432938.455281:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609577728:12345-0@lo:400:kworker.0 Request processed in 28us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432938.455286:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787432938.455298:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432938.455311:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609577344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432938.455345:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609577344:12345-0@lo:400:kworker.0 Request processed in 35us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432938.455350:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432938.455362:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787432938.455368:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843d5aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609577856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432938.455409:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843d5aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609577856:12345-0@lo:400:kworker.0 Request processed in 41us (1088us total) trans 0 rc 0/0 00000100:00080000:3.0:1787432938.455545:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432938.455567:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609577728:0@lo:400:kworker.0 00000100:00100000:3.0:1787432938.455578:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609577216:0@lo:400:kworker.0 00000100:00100000:1.0:1787432938.455622:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432938.458533:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609577344:0@lo:400:kworker.0 00000100:00100000:2.0:1787432938.458556:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609577856:0@lo:400:kworker.0 00000100:00100000:2.0:1787432938.458583:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609578368:0@lo:400:kworker.0 00010000:00010000:1.0:1787432938.637494:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432939.550050:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432939.550098:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432939.550131:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432939.550201:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432939.550235:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432939.550271:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432939.550295:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432939.550311:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432939.550352:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432939.550386:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588494336 00000100:00100000:2.0:1787432939.550451:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588494336 00000100:00100000:2.0:1787432939.550511:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588494848 00000100:00100000:2.0:1787432939.550515:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588494848 00000100:00100000:2.0:1787432939.550528:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588494464 00000100:00100000:2.0:1787432939.550530:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588494464 00000100:00100000:2.0:1787432939.550543:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588494976 00000100:00100000:2.0:1787432939.550544:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588494976 00000100:00100000:2.0:1787432939.550559:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:2.0:1787432939.550570:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:454691f5-94b0-49cf-b719-d8e9565d245e+5:2403:x1874258588494336:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432939.550647:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:454691f5-94b0-49cf-b719-d8e9565d245e+5:2403:x1874258588494336:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 79us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432939.550668:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:2.0:1787432939.550686:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:2.0:1787432939.550693:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1550083-39d1-481c-8177-f7494d742169+5:2403:x1874258588494848:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432939.550720:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1550083-39d1-481c-8177-f7494d742169+5:2403:x1874258588494848:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432939.550726:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:2.0:1787432939.550739:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:2.0:1787432939.550746:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:454691f5-94b0-49cf-b719-d8e9565d245e+5:2403:x1874258588494464:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432939.550769:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:454691f5-94b0-49cf-b719-d8e9565d245e+5:2403:x1874258588494464:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432939.550775:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:2.0:1787432939.550786:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:2.0:1787432939.550792:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1550083-39d1-481c-8177-f7494d742169+6:2403:x1874258588494976:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432939.550880:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588494080 00000100:00100000:1.0:1787432939.550885:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588494080 00000100:00100000:1.0:1787432939.550926:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588494592 00000100:00100000:1.0:1787432939.550929:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588494592 00000100:00100000:0.0:1787432939.550931:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588494208 00000100:00100000:0.0:1787432939.550935:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588494208 00000100:00100000:1.0:1787432939.550941:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588494720 00000100:00100000:1.0:1787432939.550944:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588494720 00000100:00100000:1.0:1787432939.550956:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 44 00000100:00100000:1.0:1787432939.550963:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+6:2403:x1874258588494080:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432939.550978:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1550083-39d1-481c-8177-f7494d742169+6:2403:x1874258588494976:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 186us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432939.550985:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:1.0:1787432939.550993:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+6:2403:x1874258588494080:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (955us total) trans 0 rc 0/0 00000100:00080000:2.0:1787432939.552619:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432939.552629:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787432939.552633:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787432939.552635:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432939.553045:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 45 00000100:00100000:0.0:1787432939.553070:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1550083-39d1-481c-8177-f7494d742169+6:2403:x1874258588494592:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432939.553156:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1550083-39d1-481c-8177-f7494d742169+6:2403:x1874258588494592:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 101us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432939.553180:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 45 00000100:00100000:0.0:1787432939.553214:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:0.0:1787432939.553222:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+5:2403:x1874258588494208:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432939.553248:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+5:2403:x1874258588494208:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432939.553904:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:0.0:1787432939.553934:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 47 00000100:00100000:0.0:1787432939.553945:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1550083-39d1-481c-8177-f7494d742169+5:2403:x1874258588494720:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432939.554016:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1550083-39d1-481c-8177-f7494d742169+5:2403:x1874258588494720:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 74us (3703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432939.554023:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 47 00000100:00100000:1.0:1787432939.555887:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 44 00000100:00100000:1.0:1787432939.555958:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588493952 00000100:00100000:1.0:1787432939.555966:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588493952 00000100:00100000:1.0:1787432939.556012:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 144 00000100:00100000:1.0:1787432939.556022:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:2403:x1874258588493952:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432939.556083:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:2403:x1874258588493952:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 62us (5846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432939.556107:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 144 00010000:00010000:0.0:1787432939.660121:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787432939.993355:0:25040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c1550083-39d1-481c-8177-f7494d742169 00000020:00000080:1.0:1787432940.278782:0:25746:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9b173f00 20000000:00000080:1.0:1787432940.278803:0:25746:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94843e30a000 uarg=0000000000000000 20000000:01000000:1.0:1787432940.278844:0:25746:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787432940.278851:0:25746:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787432940.278856:0:25746:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787432940.280380:0:25747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1787432940.280466:0:25746:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787432940.287400:0:25746:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787432940.287661:0:25746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948302774e00/0xca72b3b335640ac9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.287687:0:25746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948301f04000/0xca72b3b335640726 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564071f expref: 23 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.287695:0:25746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948301f05a00/0xca72b3b335640734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564072d expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.287702:0:25746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948302690400/0xca72b3b335640773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564076c expref: 23 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.287710:0:25746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94843f85e800/0xca72b3b3356408f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356408ed expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.287720:0:25746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948301edbc00/0xca72b3b335640a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5326 expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.287728:0:25746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948302774000/0xca72b3b335640a98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5396 expref: 12 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.287736:0:25746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948302774e00/0xca72b3b335640ac9 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.287799:0:25746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948302774000/0xca72b3b335640a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5396 expref: 12 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.287814:0:25746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948302774000/0xca72b3b335640a98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5396 expref: 12 pid: 22712 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432940.287829:0:25746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1874258609578880:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432940.287944:0:25746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948301edbc00/0xca72b3b335640a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5326 expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.287953:0:25746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948301edbc00/0xca72b3b335640a59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5326 expref: 12 pid: 22714 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432940.287963:0:25746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1874258609579008:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432940.287995:0:25746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94843f85e800/0xca72b3b3356408f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b3356408ed expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.288002:0:25746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94843f85e800/0xca72b3b3356408f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b3356408ed expref: 23 pid: 22711 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432940.288011:0:25746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1874258609579136:0@lo:104: 00000100:00100000:1.0:1787432940.288061:0:25746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787432940.288150:0:25746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948302690400/0xca72b3b335640773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33564076c expref: 23 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.288159:0:25746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948302690400/0xca72b3b335640773 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33564076c expref: 23 pid: 22712 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432940.288399:0:25746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1874258609579264:0@lo:104: 00000100:00100000:1.0:1787432940.288425:0:25746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787432940.291658:0:25746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948301f05a00/0xca72b3b335640734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33564072d expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.291677:0:25746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948301f05a00/0xca72b3b335640734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33564072d expref: 23 pid: 22714 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432940.291691:0:25746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1874258609579392:0@lo:104: 00000100:00100000:1.0:1787432940.291743:0:25746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432940.292377:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609579136 00000100:00100000:3.0:1787432940.292388:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609579136 00000100:00100000:3.0:1787432940.292452:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609579264 00000100:00100000:3.0:1787432940.292456:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609579264 00000100:00100000:3.0:1787432940.292493:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787432940.292503:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+4:25746:x1874258609579136:12345-0@lo:104: 00010000:00010000:3.0:1787432940.292519:0:22703:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484013fde00/0xca72b3b3356408ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356408f4 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.292614:0:22703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787432940.292621:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+4:25746:x1874258609579136:12345-0@lo:104: Request processed in 119us (4560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432940.292628:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787432940.292646:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787432940.292654:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+3:25746:x1874258609579264:12345-0@lo:104: 00010000:00010000:3.0:1787432940.292663:0:22703:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b33564076c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b335640773 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432940.292673:0:22707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432940.292683:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484013fde00/0xca72b3b3356408ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b3356408f4 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432940.292693:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fde00 already unused, calling callback (ffffffffc122fc20) 00010000:00010000:3.0:1787432940.292702:0:22703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1787432940.292705:0:22707:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484013fde00/0xca72b3b3356408ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b3356408f4 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432940.292711:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+3:25746:x1874258609579264:12345-0@lo:104: Request processed in 56us (4283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432940.292721:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787432940.292726:0:22707:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484013fde00/0xca72b3b3356408ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b3356408f4 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432940.292734:0:22707:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484013fde00/0xca72b3b3356408ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b3356408f4 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.292739:0:25337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1787432940.292740:0:22707:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787432940.292746:0:25337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b33564076c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b335640773 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.292755:0:25337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fe00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1787432940.292759:0:25337:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b33564076c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b335640773 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.292767:0:25337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b33564076c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b335640773 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432940.292780:0:22707:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484013fde00/0xca72b3b3356408ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356408f4 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432940.292786:0:25337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b33564076c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b335640773 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432940.292789:0:22707:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1787432940.292796:0:25337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787432940.292812:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484013fde00/0xca72b3b3356408ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356408f4 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.292817:0:25337:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b33564076c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b335640773 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432940.292820:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484013fde00/0xca72b3b3356408ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b3356408f4 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.292833:0:25337:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432940.292851:0:25337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b33564076c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b335640773 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.292859:0:25337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff94843f85fe00/0xca72b3b33564076c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b335640773 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.292871:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432940.292873:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432940.292875:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432940.292893:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432940.292907:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a13c04c-dd5b-4f06-b031-814868f35d81:3643:1874258609579520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787432940.292941:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432940.292971:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a13c04c-dd5b-4f06-b031-814868f35d81:3641:1874258609579648:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432940.292981:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432940.292984:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432940.292987:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432940.292995:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432940.293031:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609579520 00000100:00100000:3.0:1787432940.293035:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609579520 00010000:00010000:3.0:1787432940.293053:0:22706:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94843f85e800/0xca72b3b3356408f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356408ed expref: 24 pid: 22711 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432940.293082:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609579648 00000100:00100000:3.0:1787432940.293084:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609579648 00010000:00010000:3.0:1787432940.293103:0:22706:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948302690400/0xca72b3b335640773 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33564076c expref: 25 pid: 22712 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432940.293119:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787432940.293124:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a13c04c-dd5b-4f06-b031-814868f35d81+25:3643:x1874258609579520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432940.293133:0:22706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432940.293138:0:22706:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94843f85e800/0xca72b3b3356408f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b3356408ed expref: 25 pid: 22711 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.293148:0:22706:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94843f85e800/0xca72b3b3356408f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b3356408ed expref: 25 pid: 22711 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.293188:0:22706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432940.293208:0:22705:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787432940.293218:0:22705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787432940.293221:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a13c04c-dd5b-4f06-b031-814868f35d81+25:3643:x1874258609579520:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432940.293228:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787432940.293257:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787432940.293264:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a13c04c-dd5b-4f06-b031-814868f35d81+24:3641:x1874258609579648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432940.293273:0:22706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432940.293278:0:22706:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948302690400/0xca72b3b335640773 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33564076c expref: 24 pid: 22712 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.293286:0:22706:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948302690400/0xca72b3b335640773 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33564076c expref: 24 pid: 22712 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.293297:0:22706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432940.293325:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a13c04c-dd5b-4f06-b031-814868f35d81+24:3641:x1874258609579648:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432940.293332:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787432940.293380:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a13c04c-dd5b-4f06-b031-814868f35d81:3641:1874258609579648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787432940.293403:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a13c04c-dd5b-4f06-b031-814868f35d81:3643:1874258609579520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787432940.294770:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432940.294808:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588495104 00000100:00100000:3.0:1787432940.294814:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588495104 00010000:00010000:3.0:1787432940.294847:0:22705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948302774000/0xca72b3b335640a98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5396 expref: 13 pid: 22712 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432940.294878:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 11 00000100:00100000:3.0:1787432940.294897:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:2402:x1874258588495104:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432940.294909:0:22705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432940.294914:0:22705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948302774000/0xca72b3b335640a98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5396 expref: 13 pid: 22712 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.294926:0:22705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948302774000/0xca72b3b335640a98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5396 expref: 13 pid: 22712 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.294942:0:22705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432940.294985:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:2402:x1874258588495104:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 90us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432940.294993:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 11 00000100:00100000:2.0:1787432940.297195:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432940.297380:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588495232 00000100:00100000:3.0:1787432940.297390:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588495232 00010000:00010000:3.0:1787432940.297421:0:22704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948301edbc00/0xca72b3b335640a59 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5326 expref: 13 pid: 22714 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432940.297464:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:3.0:1787432940.297473:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ada680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:2400:x1874258588495232:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432940.297499:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432940.297505:0:22704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948301edbc00/0xca72b3b335640a59 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5326 expref: 13 pid: 22714 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.297518:0:22704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948301edbc00/0xca72b3b335640a59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5326 expref: 13 pid: 22714 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.297549:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432940.297605:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ada680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:2400:x1874258588495232:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 133us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432940.297613:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 12 00010000:00010000:1.0:1787432940.298568:0:25746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948301f04000/0xca72b3b335640726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33564071f expref: 23 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.298583:0:25746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948301f04000/0xca72b3b335640726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33564071f expref: 23 pid: 22712 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432940.298597:0:25746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1874258609579776:0@lo:104: 00000100:00100000:1.0:1787432940.298659:0:25746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432940.298673:0:25746:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484122bf900 going to sleep for 11 seconds 00010000:00010000:1.0:1787432940.298702:0:25746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948302774000/0xca72b3b335640a98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5396 expref: 12 pid: 22712 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432940.298716:0:25746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1874258609578880:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432940.298728:0:25746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948301edbc00/0xca72b3b335640a59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5326 expref: 11 pid: 22714 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432940.298736:0:25746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1874258609579008:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432940.298762:0:25746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94843f85e800/0xca72b3b3356408f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b3356408ed expref: 23 pid: 22711 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432940.298771:0:25746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1874258609579136:0@lo:104: 00010000:00010000:1.0:1787432940.298781:0:25746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948302690400/0xca72b3b335640773 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33564076c expref: 22 pid: 22712 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432940.298788:0:25746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1874258609579264:0@lo:104: 00000100:00100000:3.0:1787432940.299130:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609579392 00000100:00100000:3.0:1787432940.299138:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609579392 00000100:00100000:3.0:1787432940.299208:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609579776 00000100:00100000:3.0:1787432940.299314:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609579776 00000100:00100000:3.0:1787432940.299338:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787432940.299347:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+4:25746:x1874258609579392:12345-0@lo:104: 00010000:00010000:3.0:1787432940.299361:0:22703:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948301f04600/0xca72b3b33564072d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b335640734 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.299429:0:22703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787432940.299435:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+4:25746:x1874258609579392:12345-0@lo:104: Request processed in 90us (7693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432940.299443:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787432940.299460:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787432940.299466:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+3:25746:x1874258609579776:12345-0@lo:104: 00010000:00010000:3.0:1787432940.299473:0:22703:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33564071f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b335640726 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.299520:0:22703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787432940.299526:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+3:25746:x1874258609579776:12345-0@lo:104: Request processed in 61us (867us total) trans 0 rc 0/0 00010000:00010000:2.0:1787432940.299539:0:22708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1787432940.299550:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787432940.299551:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948301f04600/0xca72b3b33564072d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b335640734 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432940.299562:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f04600 already unused, calling callback (ffffffffc122fc20) 00010000:00010000:3.0:1787432940.299570:0:25337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432940.299576:0:25337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33564071f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b335640726 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.299584:0:25337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ec00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1787432940.299588:0:25337:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33564071f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b335640726 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.299597:0:25337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33564071f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b335640726 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432940.299604:0:25337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33564071f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b335640726 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432940.299611:0:25337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787432940.299642:0:25337:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33564071f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b335640726 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.299648:0:25337:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432940.299666:0:25337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33564071f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b335640726 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.299673:0:25337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33564071f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b335640726 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.299696:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432940.299697:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432940.299699:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432940.299713:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a13c04c-dd5b-4f06-b031-814868f35d81:3642:1874258609579904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787432940.299755:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1787432940.299756:0:22708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948301f04600/0xca72b3b33564072d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b335640734 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432940.299767:0:22708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948301f04600/0xca72b3b33564072d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b335640734 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432940.299774:0:22708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948301f04600/0xca72b3b33564072d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b335640734 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432940.299780:0:22708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787432940.299800:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609579904 00010000:00010000:2.0:1787432940.299800:0:22708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948301f04600/0xca72b3b33564072d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b335640734 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432940.299805:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609579904 00010000:00010000:2.0:1787432940.299810:0:22708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432940.299825:0:22706:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948301f04000/0xca72b3b335640726 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33564071f expref: 22 pid: 22712 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432940.299830:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948301f04600/0xca72b3b33564072d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b335640734 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432940.299851:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787432940.299857:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843598a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a13c04c-dd5b-4f06-b031-814868f35d81+22:3642:x1874258609579904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432940.299868:0:22706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432940.299873:0:22706:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948301f04000/0xca72b3b335640726 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33564071f expref: 22 pid: 22712 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.300012:0:22706:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948301f04000/0xca72b3b335640726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33564071f expref: 22 pid: 22712 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.300031:0:22706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432940.300061:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843598a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a13c04c-dd5b-4f06-b031-814868f35d81+22:3642:x1874258609579904:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432940.300068:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1787432940.300080:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948301f04600/0xca72b3b33564072d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b335640734 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432940.300097:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432940.300099:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432940.300101:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432940.300123:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432940.300129:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a13c04c-dd5b-4f06-b031-814868f35d81:3642:1874258609579904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432940.300219:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a13c04c-dd5b-4f06-b031-814868f35d81:3644:1874258609580032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432940.300250:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432940.300380:0:25746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1874258609579392:0@lo:104: 00010000:00010000:1.0:1787432940.300392:0:25746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948301f04000/0xca72b3b335640726 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33564071f expref: 21 pid: 22712 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432940.300403:0:25746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25746:1874258609579776:0@lo:104: 00010000:00010000:1.0:1787432940.300429:0:25746:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948302774e00/0xca72b3b335640ac9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432940.300467:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609580032 00000100:00100000:3.0:1787432940.300472:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609580032 00010000:00010000:3.0:1787432940.300490:0:22705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948301f05a00/0xca72b3b335640734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33564072d expref: 21 pid: 22714 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432940.300688:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787432940.300697:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+21:3644:x1874258609580032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432940.300708:0:22705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432940.300713:0:22705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948301f05a00/0xca72b3b335640734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33564072d expref: 21 pid: 22714 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.300723:0:22705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948301f05a00/0xca72b3b335640734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33564072d expref: 21 pid: 22714 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.300734:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948301f05a00/0xca72b3b335640734 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33564072d expref: 21 pid: 22714 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.300745:0:22705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948302774e00/0xca72b3b335640ac9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.300753:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302774e00/0xca72b3b335640ac9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.300764:0:22705:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948302774e00/0xca72b3b335640ac9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.300769:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948302774e00/0xca72b3b335640ac9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.300775:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948302774e00/0xca72b3b335640ac9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.300780:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948302774e00/0xca72b3b335640ac9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.300794:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774e00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432940.300798:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948302774e00/0xca72b3b335640ac9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.300804:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948302774e00/0xca72b3b335640ac9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.300822:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948302774e00/0xca72b3b335640ac9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432940.300831:0:22705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432940.300857:0:25746:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948302774e00/0xca72b3b335640ac9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.300866:0:25746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948302774e00/0xca72b3b335640ac9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432940.300873:0:25746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948302774e00/0xca72b3b335640ac9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432940.301099:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a13c04c-dd5b-4f06-b031-814868f35d81+20:3644:x1874258609580032:12345-0@lo:103:ldlm_bl.0 Request processed in 403us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432940.301108:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787432940.301264:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a13c04c-dd5b-4f06-b031-814868f35d81:3644:1874258609580032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432940.491726:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609580160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432940.491802:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432940.491902:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609580160 00000100:00100000:2.0:1787432940.491911:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609580160 00000100:00100000:2.0:1787432940.491966:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787432940.491977:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609580160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787432940.492007:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787432940.492067:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609580160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432940.492075:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787432940.492098:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432940.492146:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609580160:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787432940.684830:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432941.515619:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609580288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432941.515738:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432941.515911:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609580288 00000100:00100000:1.0:1787432941.515925:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609580288 00000100:00100000:1.0:1787432941.516006:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787432941.516021:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609580288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787432941.516084:0:22724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787432941.516191:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609580288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 173us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432941.516201:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787432941.516358:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609580288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432941.516729:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483036e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609580416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432941.516765:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432941.518190:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609580416 00000100:00100000:1.0:1787432941.518201:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609580416 00000100:00100000:1.0:1787432941.518264:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787432941.518274:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609580416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787432941.518306:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787432941.518383:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609580416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (1617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432941.518390:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787432941.519928:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483036e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609580416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432941.538101:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432941.538260:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588495360 00000100:00100000:0.0:1787432941.538272:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588495360 00000100:00100000:0.0:1787432941.538337:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 145 00000100:00100000:0.0:1787432941.538348:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+11:18110:x1874258588495360:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432941.538366:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432941.538384:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948301eda400/0xca72b3b335640ad0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d53ce expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.538412:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948301eda400/0xca72b3b335640ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53ce expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.538424:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948301eda400/0xca72b3b335640ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53ce expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.538433:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301eda400, rc 0) 00000100:00100000:0.0:1787432941.538508:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+12:18110:x1874258588495360:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 162us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432941.538517:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 145 00000100:00100000:2.0:1787432941.554240:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432941.554761:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588495488 00000100:00100000:0.0:1787432941.554775:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588495488 00000100:00100000:0.0:1787432941.554911:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 146 00000100:00100000:0.0:1787432941.554924:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+12:18110:x1874258588495488:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432941.555115:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+12:18110:x1874258588495488:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 193us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432941.555125:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 146 00000100:00100000:2.0:1787432941.573134:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432941.573328:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588495616 00000100:00100000:1.0:1787432941.573341:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588495616 00000100:00100000:1.0:1787432941.573439:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 147 00000100:00100000:1.0:1787432941.573451:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+12:18110:x1874258588495616:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432941.573619:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+12:18110:x1874258588495616:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 170us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432941.573627:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 147 00000100:00100000:2.0:1787432941.583716:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432941.583865:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588495744 00000100:00100000:0.0:1787432941.583876:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588495744 00000100:00100000:0.0:1787432941.583942:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 148 00000100:00100000:0.0:1787432941.583953:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+12:18110:x1874258588495744:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432941.583984:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432941.584005:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948301eda800/0xca72b3b335640ad7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d53d5 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.584036:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948301eda800/0xca72b3b335640ad7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53d5 expref: 13 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.584046:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948301eda800/0xca72b3b335640ad7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53d5 expref: 13 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.584056:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301eda800, rc 0) 00000100:00100000:0.0:1787432941.584137:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:18110:x1874258588495744:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 184us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432941.584144:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 148 00000100:00100000:2.0:1787432941.591982:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432941.592247:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588495872 00000100:00100000:1.0:1787432941.592257:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588495872 00000100:00100000:1.0:1787432941.592319:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 149 00000100:00100000:1.0:1787432941.592330:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:18110:x1874258588495872:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432941.592585:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:18110:x1874258588495872:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 255us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432941.592612:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 149 00000100:00100000:2.0:1787432941.596224:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432941.596329:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588496000 00000100:00100000:3.0:1787432941.596341:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588496000 00000100:00100000:3.0:1787432941.596444:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 150 00000100:00100000:3.0:1787432941.596455:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:18110:x1874258588496000:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432941.601609:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:18110:x1874258588496000:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 5141us (5569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432941.601629:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 150 00010000:00010000:3.0:1787432941.707443:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432941.747525:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432941.747590:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588496128 00000100:00100000:0.0:1787432941.747600:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588496128 00000100:00100000:0.0:1787432941.747730:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:0.0:1787432941.747744:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+6:18732:x1874258588496128:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432941.747780:0:23799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432941.747800:0:23799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb600/0xca72b3b335640ade lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d53dc expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.747887:0:23799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640ae5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.747903:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640ae5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.747915:0:23799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640ae5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.747931:0:23799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640aec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.747939:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640aec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.747946:0:23799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640aec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748027:0:23799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edba00/0xca72b3b335640af3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748036:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301edba00/0xca72b3b335640af3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748044:0:23799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edba00/0xca72b3b335640af3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432941.748071:0:23799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787432941.748081:0:23799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787432941.748120:0:23799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948301edba00/0xca72b3b335640af3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748131:0:23799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640ae5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748137:0:23799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640ae5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748144:0:23799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640ae5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748150:0:23799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301eda000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432941.748154:0:23799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640ae5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748161:0:23799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640ae5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748208:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766900) 00010000:00010000:0.0:1787432941.748211:0:23799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432941.748215:0:23799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640ae5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748221:0:23799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640ae5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748234:0:23799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640aec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748241:0:23799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640aec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748258:0:23799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640aec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748263:0:23799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edaa00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432941.748266:0:23799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640aec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748273:0:23799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640aec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748280:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff948411a7a100) 00010000:00010000:0.0:1787432941.748282:0:23799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432941.748285:0:23799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640aec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748291:0:23799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640aec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748321:0:23799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb600/0xca72b3b335640ade lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53dc expref: 8 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748336:0:23799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edba00/0xca72b3b335640af3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53dc expref: 7 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.748343:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff948411a7ab00) 00010000:00010000:0.0:1787432941.748345:0:23799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787432941.748348:0:23799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301edba00, rc 0) 00000100:00100000:0.0:1787432941.748427:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+7:18732:x1874258588496128:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 687us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432941.748446:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00080000:2.0:1787432941.749061:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432941.764972:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432941.765099:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588496256 00000100:00100000:3.0:1787432941.765110:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588496256 00000100:00100000:3.0:1787432941.765214:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:3.0:1787432941.765226:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:454691f5-94b0-49cf-b719-d8e9565d245e+7:18732:x1874258588496256:12345-192.168.204.24@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787432941.765414:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:454691f5-94b0-49cf-b719-d8e9565d245e+7:18732:x1874258588496256:12345-192.168.204.24@tcp:900:lhsmtool_posix.0 Request processed in 190us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432941.765423:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:3.0:1787432941.769441:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432941.769538:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588496512 00000100:00100000:1.0:1787432941.769548:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588496512 00000100:00100000:1.0:1787432941.769614:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:1.0:1787432941.769625:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+7:18732:x1874258588496512:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432941.769648:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432941.769674:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640afa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d53e3 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.769751:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b01 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.769765:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.769778:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.769792:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b08 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.769799:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.769806:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.769958:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775a00/0xca72b3b335640b0f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.769989:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775a00/0xca72b3b335640b0f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.769996:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775a00/0xca72b3b335640b0f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432941.770007:0:22720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787432941.770157:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.770210:0:22720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b01 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.770218:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.770224:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432941.770228:0:22720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.770237:0:22720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b01 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.770248:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff948411a7ab00) 00010000:00010000:1.0:1787432941.770252:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432941.770256:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.770263:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.770275:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.770287:0:22720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b08 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.770293:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.770298:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432941.770301:0:22720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.770308:0:22720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b08 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.770316:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff948303542200) 00010000:00010000:1.0:1787432941.770318:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432941.770321:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b08 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.770327:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b08 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.775424:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640afa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53e3 expref: 10 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.775452:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775a00/0xca72b3b335640b0f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53e3 expref: 9 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.775462:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948303542100) 00010000:00010000:1.0:1787432941.775465:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432941.775485:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302775a00, rc 0) 00000100:00100000:1.0:1787432941.776102:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+9:18732:x1874258588496512:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 6474us (6667us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1787432941.776112:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:2.0:1787432941.789729:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432941.789846:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588496640 00000100:00100000:1.0:1787432941.789866:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588496640 00000100:00100000:1.0:1787432941.789922:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:1.0:1787432941.789933:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+9:18732:x1874258588496640:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787432941.790053:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+9:18732:x1874258588496640:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 121us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432941.790061:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:3.0:1787432941.793645:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432941.795132:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588496768 00000100:00100000:2.0:1787432941.795150:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588496768 00000100:00100000:2.0:1787432941.795272:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 26 00000100:00100000:2.0:1787432941.795288:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+5:18732:x1874258588496768:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1787432941.795654:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1787432941.804999:0:22719:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 9666us 00000100:00100000:3.0:1787432941.842758:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+5:18732:x1874258588496768:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 47465us (49117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432941.842772:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 26 00000100:00100000:3.0:1787432941.861812:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432941.862823:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588496896 00000100:00100000:1.0:1787432941.862835:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588496896 00000100:00100000:1.0:1787432941.862904:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 27 00000100:00100000:1.0:1787432941.862916:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+9:18738:x1874258588496896:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432941.862937:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432941.862957:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640b1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d53ea expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863135:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863266:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863280:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863296:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863379:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863387:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863537:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863645:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863653:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863659:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432941.863664:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863672:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863684:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766900) 00010000:00010000:1.0:1787432941.863687:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432941.863692:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863698:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775200/0xca72b3b335640b24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863712:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863724:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863731:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863736:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432941.863739:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863746:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863753:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff948303542200) 00010000:00010000:1.0:1787432941.863756:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432941.863759:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863765:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863796:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640b1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53ea expref: 10 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863806:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766900) 00010000:00010000:1.0:1787432941.863809:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432941.863812:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640b1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53ea expref: 10 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.863832:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302774e00, rc 0) 00000100:00100000:1.0:1787432941.863910:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+9:18738:x1874258588496896:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 996us (2106us total) trans 0 rc 301/301 00000100:00100000:1.0:1787432941.863918:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 27 00000100:00100000:2.0:1787432941.867920:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432941.868058:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588497024 00000100:00100000:0.0:1787432941.868069:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588497024 00000100:00100000:0.0:1787432941.868244:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:0.0:1787432941.868257:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:454691f5-94b0-49cf-b719-d8e9565d245e+9:18738:x1874258588497024:12345-192.168.204.24@tcp:700:lfs.0 00000100:00100000:0.0:1787432941.868370:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:454691f5-94b0-49cf-b719-d8e9565d245e+9:18738:x1874258588497024:12345-192.168.204.24@tcp:700:lfs.0 Request processed in 116us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432941.868378:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:3.0:1787432941.870315:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432941.870557:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588497280 00000100:00100000:1.0:1787432941.870567:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588497280 00000100:00100000:1.0:1787432941.870631:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 28 00000100:00100000:1.0:1787432941.870643:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+9:18738:x1874258588497280:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:1.0:1787432941.870712:0:22720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432941.870750:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640a83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5357 expref: 9 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.870770:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766900) 00010000:00010000:1.0:1787432941.870775:0:22720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432941.870846:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775400/0xca72b3b335640b32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.870903:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb000/0xca72b3b335640ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53c7 expref: 5 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.870920:0:22720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302775400/0xca72b3b335640b32 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.870964:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb000/0xca72b3b335640ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53c7 expref: 5 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.870977:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb000/0xca72b3b335640ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53c7 expref: 5 pid: 22720 timeout: 852 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432941.871016:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22720:1874258609580544:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432941.871112:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484164f4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787432941.875263:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22720:1874258609580544:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432941.875300:0:22720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948302775400/0xca72b3b335640b32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432941.876003:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432941.876256:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588497408 00000100:00100000:0.0:1787432941.876265:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588497408 00010000:00010000:0.0:1787432941.876361:0:22706:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb000/0xca72b3b335640ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53c7 expref: 6 pid: 22720 timeout: 852 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432941.876401:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:0.0:1787432941.876411:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1550083-39d1-481c-8177-f7494d742169+6:2402:x1874258588497408:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432941.876426:0:22706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432941.876434:0:22706:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb000/0xca72b3b335640ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53c7 expref: 6 pid: 22720 timeout: 852 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.876447:0:22706:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb000/0xca72b3b335640ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53c7 expref: 6 pid: 22720 timeout: 852 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.876469:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb000/0xca72b3b335640ac2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53c7 expref: 6 pid: 22720 timeout: 852 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.876504:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766900) 00010000:00010000:0.0:1787432941.876509:0:22706:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff948302775400/0xca72b3b335640b32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.876518:0:22706:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775400/0xca72b3b335640b32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.876525:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775400/0xca72b3b335640b32 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.876563:0:22706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432941.876606:0:22720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948302775400/0xca72b3b335640b32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432941.876613:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1550083-39d1-481c-8177-f7494d742169+5:2402:x1874258588497408:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 204us (612us total) trans 0 rc 0/0 00010000:00010000:1.0:1787432941.876614:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775400/0xca72b3b335640b32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432941.876620:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 15 00010000:00010000:1.0:1787432941.876645:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640b39 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.876655:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640b39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.876669:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640b39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.878496:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b40 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.878510:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b40 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.878519:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b40 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787432941.878558:0:22720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f710c387 reply state 0000000009a50a66 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b40 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.878572:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b40 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.878579:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948303542f00) 00010000:00010000:1.0:1787432941.878582:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787432941.878584:0:22720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787432941.878590:0:22720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787432941.878597:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775400/0xca72b3b335640b32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.878604:0:22720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302775400/0xca72b3b335640b32 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.878610:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302775400/0xca72b3b335640b32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.878616:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432941.878620:0:22720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775400/0xca72b3b335640b32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.878627:0:22720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775400/0xca72b3b335640b32 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.878636:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766900) 00010000:00010000:1.0:1787432941.878639:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432941.878643:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302775400/0xca72b3b335640b32 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.878659:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775400/0xca72b3b335640b32 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787432941.878678:0:22720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f710c387 reply state 0000000009a50a66 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640b39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.878688:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640b39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.878693:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff948303542200) 00010000:00010000:1.0:1787432941.878696:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787432941.878698:0:22720:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787432941.878827:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+10:18738:x1874258588497280:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 8182us (8516us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787432941.878836:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 28 00000100:00080000:2.0:1787432941.879301:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1787432941.900120:0:22716:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787432941.900146:0:22716:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9484166d5000 from 13 10000000:01000000:2.0:1787432941.900151:0:22716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787432941.900232:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f05000/0xca72b3b335640b47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432941.900244:0:22716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948301f05000/0xca72b3b335640b47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432941.900257:0:22716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948301f05000/0xca72b3b335640b47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432941.900285:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609580672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432941.900360:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432941.900411:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791480 going to sleep for 11 seconds 00000100:00100000:1.0:1787432941.900642:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609580672 00000100:00100000:1.0:1787432941.900651:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609580672 00000100:00100000:1.0:1787432941.900706:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787432941.900717:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+20:22716:x1874258609580672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432941.900731:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432941.900745:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302775400/0xca72b3b335640b4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b335640b47 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.900772:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302775400/0xca72b3b335640b4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b335640b47 expref: 21 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.900782:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302775400/0xca72b3b335640b4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b335640b47 expref: 21 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.900804:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302775400, rc 0) 00000100:00100000:1.0:1787432941.900868:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+21:22716:x1874258609580672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432941.900875:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787432941.901119:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609580672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432941.901135:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948301f05000/0xca72b3b335640b47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640b4e expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432941.901145:0:22716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948301f05000/0xca72b3b335640b47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640b4e expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432941.901247:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609580800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432941.901276:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432941.901307:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791480 going to sleep for 11 seconds 00000100:00100000:3.0:1787432941.901369:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609580800 00000100:00100000:3.0:1787432941.901374:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609580800 00000100:00100000:3.0:1787432941.901436:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787432941.901444:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+21:22716:x1874258609580800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432941.901573:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+21:22716:x1874258609580800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432941.901580:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787432941.902009:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609580800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432941.902057:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609580928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432941.902112:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432941.902135:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791480 going to sleep for 11 seconds 00000100:00100000:0.0:1787432941.902274:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609580928 00000100:00100000:0.0:1787432941.902279:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609580928 00000100:00100000:0.0:1787432941.902316:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787432941.902325:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+21:22716:x1874258609580928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432941.902420:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+21:22716:x1874258609580928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432941.902427:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787432941.902724:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609580928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787432941.903803:0:25761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787432941.903973:0:22716:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787432941.903991:0:22716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787432941.904001:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f05000/0xca72b3b335640b47 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640b4e expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.904011:0:22716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948301f05000/0xca72b3b335640b47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640b4e expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432941.904032:0:22716:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787432941.904034:0:22716:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9484122e5800 from 13 10000000:01000000:0.0:1787432941.904036:0:22716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787432941.904065:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301edb000/0xca72b3b335640b55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.904072:0:22716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948301edb000/0xca72b3b335640b55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.904080:0:22716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948301edb000/0xca72b3b335640b55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432941.904099:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483036e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787432941.904148:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432941.904221:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff94843e307480 going to sleep for 11 seconds 00000100:00100000:1.0:1787432941.904328:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609581056 00000100:00100000:1.0:1787432941.904334:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609581056 00000100:00100000:1.0:1787432941.904380:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787432941.904389:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+21:22716:x1874258609581056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432941.904400:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432941.904414:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302775200/0xca72b3b335640b5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b335640b55 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.904436:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302775200/0xca72b3b335640b5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b335640b55 expref: 22 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.904445:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302775200/0xca72b3b335640b5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b335640b55 expref: 22 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.904454:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302775200, rc 0) 00000100:00100000:1.0:1787432941.904494:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+22:22716:x1874258609581056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432941.904500:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787432941.904875:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483036e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432941.904890:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948301edb000/0xca72b3b335640b55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640b5c expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432941.904898:0:22716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948301edb000/0xca72b3b335640b55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640b5c expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432941.904950:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432941.904978:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432941.905004:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791480 going to sleep for 11 seconds 00000100:00100000:3.0:1787432941.905068:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609581184 00000100:00100000:3.0:1787432941.905073:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609581184 00000100:00100000:3.0:1787432941.905125:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787432941.905132:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+22:22716:x1874258609581184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432941.905507:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+22:22716:x1874258609581184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432941.905515:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787432941.905644:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432941.905675:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432941.905718:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432941.905741:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791480 going to sleep for 11 seconds 00000100:00100000:1.0:1787432941.905793:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609581312 00000100:00100000:1.0:1787432941.905798:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609581312 00000100:00100000:1.0:1787432941.905834:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787432941.905843:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+22:22716:x1874258609581312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432941.905951:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+22:22716:x1874258609581312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432941.905964:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787432941.906479:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787432941.907712:0:25762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787432941.909307:0:22716:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787432941.909344:0:22716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432941.909357:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301edb000/0xca72b3b335640b55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640b5c expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432941.909370:0:22716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948301edb000/0xca72b3b335640b55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640b5c expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432941.909383:0:22716:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787432941.909385:0:22716:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94840557e000 from 13 10000000:01000000:2.0:1787432941.909388:0:22716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787432941.909443:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f04e00/0xca72b3b335640b63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432941.909452:0:22716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948301f04e00/0xca72b3b335640b63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432941.909462:0:22716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948301f04e00/0xca72b3b335640b63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432941.909488:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432941.910825:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432941.910922:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432941.916422:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609581440 00000100:00100000:3.0:1787432941.916439:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609581440 00000100:00100000:3.0:1787432941.916508:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787432941.916519:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+22:22716:x1874258609581440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432941.916535:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432941.916733:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302690800/0xca72b3b335640b6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b335640b63 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432941.916765:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302690800/0xca72b3b335640b6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b335640b63 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432941.916777:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302690800/0xca72b3b335640b6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b335640b63 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432941.916786:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302690800, rc 0) 00000100:00100000:3.0:1787432941.916887:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+23:22716:x1874258609581440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 370us (6067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432941.916894:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787432941.916994:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432941.917014:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948301f04e00/0xca72b3b335640b63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640b6a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.917034:0:22716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948301f04e00/0xca72b3b335640b63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640b6a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432941.917125:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483036e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432941.917204:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432941.917243:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff94843e307a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432941.917354:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609581568 00000100:00100000:1.0:1787432941.917359:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609581568 00000100:00100000:1.0:1787432941.917397:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787432941.917406:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+23:22716:x1874258609581568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432941.917522:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a13c04c-dd5b-4f06-b031-814868f35d81+23:22716:x1874258609581568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432941.917530:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787432941.917828:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483036e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432941.917870:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432941.917923:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432941.917943:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff948402be6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432941.917985:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609581696 00000100:00100000:0.0:1787432941.917989:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609581696 00000100:00100000:0.0:1787432941.918036:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787432941.918043:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+23:22716:x1874258609581696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432941.918137:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+23:22716:x1874258609581696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432941.918143:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787432941.918360:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787432941.919000:0:25763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787432941.919060:0:22716:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787432941.919081:0:22716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787432941.919452:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f04e00/0xca72b3b335640b63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640b6a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432941.919464:0:22716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948301f04e00/0xca72b3b335640b63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640b6a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432941.919474:0:22716:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787432941.919477:0:22716:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94844112f000 from 13 10000000:01000000:3.0:1787432941.919480:0:22716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432941.919504:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b335640b71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432941.919512:0:22716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b335640b71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432941.919520:0:22716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b335640b71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432941.919537:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432941.919633:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432941.919709:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff948402be6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432941.920758:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609581824 00000100:00100000:0.0:1787432941.920766:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609581824 00000100:00100000:1.0:1787432941.928928:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787432941.928957:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+23:22716:x1874258609581824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432941.928992:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432941.929039:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302774800/0xca72b3b335640b78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b335640b71 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.929077:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302774800/0xca72b3b335640b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b335640b71 expref: 24 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.929099:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302774800/0xca72b3b335640b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b335640b71 expref: 24 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432941.929108:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302774800, rc 0) 00000100:00100000:1.0:1787432941.929230:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:22716:x1874258609581824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 286us (9595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432941.929237:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787432941.929445:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432941.929473:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b335640b71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640b78 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432941.929482:0:22716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b335640b71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640b78 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432941.929569:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432941.929627:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432941.929655:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432941.929890:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609581952 00000100:00100000:0.0:1787432941.929897:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609581952 00000100:00100000:0.0:1787432941.929927:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787432941.929934:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+24:22716:x1874258609581952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432941.930501:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a13c04c-dd5b-4f06-b031-814868f35d81+24:22716:x1874258609581952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 564us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432941.930510:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787432941.930685:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609581952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432941.930720:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609582080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432941.930768:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432941.930787:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787432941.930801:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609582080 00000100:00100000:2.0:1787432941.930811:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609582080 00000100:00100000:2.0:1787432941.930835:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787432941.930842:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:22716:x1874258609582080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432941.930938:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:22716:x1874258609582080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432941.930945:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787432941.930986:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a13c04c-dd5b-4f06-b031-814868f35d81:22716:1874258609582080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787432941.931897:0:25764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787432941.931962:0:22716:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787432941.931979:0:22716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432941.931989:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b335640b71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640b78 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432941.932001:0:22716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b335640b71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640b78 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432941.981278:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432941.981510:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588497536 00000100:00100000:0.0:1787432941.981519:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588497536 00000100:00100000:0.0:1787432941.981641:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 29 00000100:00100000:0.0:1787432941.981653:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+10:18746:x1874258588497536:12345-192.168.204.24@tcp:101:lctl.0 00010000:00010000:0.0:1787432941.981678:0:23799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432941.981705:0:23799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640b7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d53f1 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.981774:0:23799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640b86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.981788:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.981820:0:23799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432941.981876:0:23799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787432941.981881:0:23799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787432941.981920:0:23799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.981946:0:23799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640b7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53f1 expref: 12 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.981966:0:23799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda000/0xca72b3b335640b86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53f1 expref: 11 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432941.981974:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948411a7a100) 00010000:00010000:0.0:1787432941.981977:0:23799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787432941.981981:0:23799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301eda000, rc 0) 00000100:00100000:0.0:1787432941.982049:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+11:18746:x1874258588497536:12345-192.168.204.24@tcp:101:lctl.0 Request processed in 398us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432941.982056:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 29 00000100:00100000:3.0:1787432942.030909:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432942.031093:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588497664 00000100:00100000:2.0:1787432942.031105:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588497664 00000100:00100000:2.0:1787432942.031204:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:2.0:1787432942.031216:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1550083-39d1-481c-8177-f7494d742169+5:18747:x1874258588497664:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432942.031238:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432942.031260:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640b8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d53f8 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.031324:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b335640b94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.031338:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b335640b94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.031356:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b335640b94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432942.031404:0:22719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787432942.031409:0:22719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432942.031431:0:22719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b335640b94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.031456:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640b8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53f8 expref: 7 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.031476:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b335640b94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53f8 expref: 6 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.031485:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948411a7a100) 00010000:00010000:2.0:1787432942.031488:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432942.031492:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f04000, rc 0) 00000100:00100000:2.0:1787432942.031568:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1550083-39d1-481c-8177-f7494d742169+6:18747:x1874258588497664:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 354us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432942.031577:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:2.0:1787432942.042934:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432942.044726:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588497792 00000100:00100000:1.0:1787432942.044747:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588497792 00000100:00100000:1.0:1787432942.044833:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00100000:1.0:1787432942.044873:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1550083-39d1-481c-8177-f7494d742169+6:18747:x1874258588497792:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432942.044894:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432942.044915:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640b9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d53ff expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.044982:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640ba2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.044997:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.045009:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.045020:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640ba9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.045363:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.045370:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.045449:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640bb0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.045457:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640bb0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.045463:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640bb0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432942.045510:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787432942.045513:0:22718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432942.045532:0:22718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640bb0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046673:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046690:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640ba2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046697:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046703:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432942.046707:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046715:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640ba2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046737:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948411a7a100) 00010000:00010000:1.0:1787432942.046740:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432942.046744:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640ba2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046751:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640ba2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046766:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046791:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046797:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046803:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432942.046806:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046813:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046820:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff948303542200) 00010000:00010000:1.0:1787432942.046823:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432942.046826:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640ba9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046832:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640ba9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046884:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640b9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53ff expref: 8 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046899:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640bb0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53ff expref: 7 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.046906:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948303542f00) 00010000:00010000:1.0:1787432942.046909:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432942.046916:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302774600, rc 0) 00000100:00100000:1.0:1787432942.046990:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1550083-39d1-481c-8177-f7494d742169+7:18747:x1874258588497792:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 2119us (4069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432942.047000:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00100000:3.0:1787432942.058425:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432942.058560:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588497920 00000100:00100000:1.0:1787432942.058570:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588497920 00000100:00100000:1.0:1787432942.058659:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:1.0:1787432942.058672:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c1550083-39d1-481c-8177-f7494d742169+5:18747:x1874258588497920:12345-192.168.204.24@tcp:900:lfs.0 00000100:00100000:1.0:1787432942.058764:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c1550083-39d1-481c-8177-f7494d742169+5:18747:x1874258588497920:12345-192.168.204.24@tcp:900:lfs.0 Request processed in 95us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432942.058773:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00080000:2.0:1787432942.059287:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787432942.062841:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432942.062946:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588498176 00000100:00100000:3.0:1787432942.062956:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588498176 00000100:00100000:3.0:1787432942.063016:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 32 00000100:00100000:3.0:1787432942.063027:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1550083-39d1-481c-8177-f7494d742169+7:18747:x1874258588498176:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432942.063047:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432942.063071:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302691e00/0xca72b3b335640bb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5406 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432942.063221:0:22719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787432942.063325:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948302691e00/0xca72b3b335640bb7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5406 expref: 9 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.063341:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948411a7a100) 00010000:00010000:3.0:1787432942.063344:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432942.063349:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302691e00/0xca72b3b335640bb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5406 expref: 9 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.063363:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302691e00, rc 0) 00000100:00100000:3.0:1787432942.063430:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1550083-39d1-481c-8177-f7494d742169+8:18747:x1874258588498176:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 404us (600us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1787432942.063437:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 32 00000100:00100000:0.0:1787432942.076486:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432942.076656:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588498432 00000100:00100000:3.0:1787432942.076666:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588498432 00000100:00100000:3.0:1787432942.076725:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:3.0:1787432942.076738:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1550083-39d1-481c-8177-f7494d742169+8:18747:x1874258588498432:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:3.0:1787432942.076800:0:23799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432942.076841:0:23799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640bb0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d53ff expref: 8 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.076873:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948303542f00) 00010000:00010000:3.0:1787432942.076878:0:23799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432942.076902:0:23799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948302691e00/0xca72b3b335640bc5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.076917:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302691e00/0xca72b3b335640bc5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.076928:0:23799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302691e00/0xca72b3b335640bc5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432942.077149:0:23799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fac69b01 reply state 0000000005cbfcfe transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff948302691e00/0xca72b3b335640bc5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.077161:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302691e00/0xca72b3b335640bc5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.077214:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948303542f00) 00010000:00010000:3.0:1787432942.077217:0:23799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1787432942.077220:0:23799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787432942.077228:0:23799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787432942.077317:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1550083-39d1-481c-8177-f7494d742169+9:18747:x1874258588498432:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 581us (839us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787432942.077325:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:2.0:1787432942.080801:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432942.080918:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588498688 00000100:00100000:0.0:1787432942.080928:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588498688 00000100:00100000:0.0:1787432942.080987:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:0.0:1787432942.080998:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c1550083-39d1-481c-8177-f7494d742169+9:18747:x1874258588498688:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:0.0:1787432942.081299:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c1550083-39d1-481c-8177-f7494d742169+10:18747:x1874258588498688:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 301us (506us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1787432942.081327:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:2.0:1787432942.086477:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432942.086801:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588498944 00000100:00100000:3.0:1787432942.086812:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588498944 00000100:00100000:3.0:1787432942.086891:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 34 00000100:00100000:3.0:1787432942.086903:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1550083-39d1-481c-8177-f7494d742169+10:18747:x1874258588498944:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432942.086949:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432942.086970:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302691000/0xca72b3b335640bcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d540d expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087051:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302690400/0xca72b3b335640bd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087065:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302690400/0xca72b3b335640bd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087076:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302690400/0xca72b3b335640bd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087102:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302690c00/0xca72b3b335640bda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087110:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302690c00/0xca72b3b335640bda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087117:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302690c00/0xca72b3b335640bda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432942.087264:0:22719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787432942.087336:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302690400/0xca72b3b335640bd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087344:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302690400/0xca72b3b335640bd3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087350:0:22719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302690400/0xca72b3b335640bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087366:0:22719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302690400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432942.087371:0:22719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302690400/0xca72b3b335640bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087379:0:22719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302690400/0xca72b3b335640bd3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087391:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948411a7a100) 00010000:00010000:3.0:1787432942.087394:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432942.087399:0:22719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302690400/0xca72b3b335640bd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087405:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302690400/0xca72b3b335640bd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087418:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302690c00/0xca72b3b335640bda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087424:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302690c00/0xca72b3b335640bda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087429:0:22719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302690c00/0xca72b3b335640bda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087435:0:22719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302690c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432942.087437:0:22719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302690c00/0xca72b3b335640bda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087443:0:22719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302690c00/0xca72b3b335640bda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087462:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff948303542200) 00010000:00010000:3.0:1787432942.087464:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432942.087467:0:22719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302690c00/0xca72b3b335640bda lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087472:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302690c00/0xca72b3b335640bda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087506:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948302691000/0xca72b3b335640bcc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d540d expref: 12 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087515:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948411a7a100) 00010000:00010000:3.0:1787432942.087518:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432942.087521:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302691000/0xca72b3b335640bcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d540d expref: 12 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.087531:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302691000, rc 0) 00000100:00100000:2.0:1787432942.094825:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1550083-39d1-481c-8177-f7494d742169+11:18747:x1874258588498944:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 7907us (8341us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1787432942.094841:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 34 00000100:00100000:2.0:1787432942.110267:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432942.110461:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588499072 00000100:00100000:3.0:1787432942.110473:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588499072 00000100:00100000:3.0:1787432942.110541:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 35 00000100:00100000:3.0:1787432942.110562:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1550083-39d1-481c-8177-f7494d742169+11:18747:x1874258588499072:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432942.110586:0:23799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432942.110605:0:23799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b335640be8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5414 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.110704:0:23799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b335640bef lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.110737:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b335640bef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.110749:0:23799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b335640bef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432942.110778:0:23799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787432942.110781:0:23799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432942.110800:0:23799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b335640bef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.110827:0:23799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b335640be8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5414 expref: 13 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.110857:0:23799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b335640bef lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5414 expref: 12 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432942.110865:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948303542f00) 00010000:00010000:3.0:1787432942.110868:0:23799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432942.110871:0:23799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f1600, rc 0) 00000100:00100000:3.0:1787432942.110935:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1550083-39d1-481c-8177-f7494d742169+12:18747:x1874258588499072:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 374us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432942.110943:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 35 00000100:00100000:3.0:1787432942.119218:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432942.119515:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588499200 00000100:00100000:2.0:1787432942.119525:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588499200 00000100:00100000:2.0:1787432942.119598:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:2.0:1787432942.119609:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1550083-39d1-481c-8177-f7494d742169+12:18747:x1874258588499200:12345-192.168.204.24@tcp:37:lfs.0 00000100:00100000:1.0:1787432942.124517:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1550083-39d1-481c-8177-f7494d742169+12:18747:x1874258588499200:12345-192.168.204.24@tcp:37:lfs.0 Request processed in 4898us (5342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432942.124530:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:3.0:1787432942.131389:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432942.131575:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588499456 00000100:00100000:1.0:1787432942.131587:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588499456 00000100:00100000:1.0:1787432942.131660:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:1.0:1787432942.131673:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303142450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1550083-39d1-481c-8177-f7494d742169+12:18747:x1874258588499456:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:1.0:1787432942.132112:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303142450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1550083-39d1-481c-8177-f7494d742169+13:18747:x1874258588499456:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 441us (732us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1787432942.132659:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 4 00000040:00080000:3.0:1787432942.156883:0:22754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787432942.223029:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432942.228415:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588499584 00000100:00100000:1.0:1787432942.228432:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588499584 00000100:00100000:1.0:1787432942.228584:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 36 00000100:00100000:1.0:1787432942.228597:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+11:18753:x1874258588499584:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787432942.228620:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432942.228659:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640bf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d541b expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.228731:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640bfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.228746:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640bfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.228757:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640bfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.228770:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.228777:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.228783:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.228871:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774200/0xca72b3b335640c0b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.228880:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302774200/0xca72b3b335640c0b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.228887:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774200/0xca72b3b335640c0b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432942.228921:0:22720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787432942.228926:0:22720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432942.228967:0:22720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948302774200/0xca72b3b335640c0b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.228986:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640bfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.228993:0:22720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640bfd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.229000:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640bfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.229006:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432942.229010:0:22720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640bfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.229018:0:22720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640bfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.229031:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948411a7a100) 00010000:00010000:1.0:1787432942.229034:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432942.229038:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640bfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.229045:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640bfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.229057:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.229064:0:22720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.229070:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.229093:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432942.229097:0:22720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.229103:0:22720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.229112:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff948303542200) 00010000:00010000:1.0:1787432942.229114:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432942.229128:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.229134:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.229200:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640bf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d541b expref: 13 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.229216:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774200/0xca72b3b335640c0b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d541b expref: 12 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.229234:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948303542f00) 00010000:00010000:1.0:1787432942.229236:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787432942.229239:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302774200, rc 0) 00000100:00100000:1.0:1787432942.229314:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+12:18753:x1874258588499584:12345-192.168.204.24@tcp:101:bash.0 Request processed in 720us (6305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432942.229322:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 36 00000100:00100000:3.0:1787432942.236974:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432942.237314:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588499712 00000100:00100000:0.0:1787432942.237328:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588499712 00000100:00100000:0.0:1787432942.237401:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:0.0:1787432942.237415:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:454691f5-94b0-49cf-b719-d8e9565d245e+5:18753:x1874258588499712:12345-192.168.204.24@tcp:900:bash.0 00000100:00100000:0.0:1787432942.237507:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:454691f5-94b0-49cf-b719-d8e9565d245e+5:18753:x1874258588499712:12345-192.168.204.24@tcp:900:bash.0 Request processed in 96us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432942.237517:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:3.0:1787432942.242915:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432942.243026:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588499968 00000100:00100000:0.0:1787432942.243037:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588499968 00000100:00100000:0.0:1787432942.243101:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 37 00000100:00100000:0.0:1787432942.243112:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+12:18753:x1874258588499968:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787432942.243144:0:23799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432942.243192:0:23799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb800/0xca72b3b335640c12 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5422 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432942.243311:0:23799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640c19 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432942.243328:0:23799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b335640bef lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5414 expref: 12 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432942.243337:0:23799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640c19 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432942.243728:0:23799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b335640bef lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5414 expref: 12 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432942.243766:0:23799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b335640bef lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5414 expref: 12 pid: 23799 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432942.243780:0:23799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483036e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23799:1874258609582208:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787432942.243883:0:23799:0:(client.c:2715:ptlrpc_set_wait()) set ffff94843e307300 going to sleep for 11 seconds 00000100:00100000:3.0:1787432942.251476:0:23799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483036e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23799:1874258609582208:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432942.251510:0:23799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640c19 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432942.254810:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432942.254905:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588500096 00000100:00100000:1.0:1787432942.254937:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588500096 00010000:00010000:1.0:1787432942.254985:0:22704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b335640bef lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5414 expref: 13 pid: 23799 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432942.255035:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:1.0:1787432942.255045:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1550083-39d1-481c-8177-f7494d742169+13:2403:x1874258588500096:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432942.255061:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432942.255067:0:22704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b335640bef lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5414 expref: 13 pid: 23799 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.255080:0:22704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b335640bef lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5414 expref: 13 pid: 23799 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.255101:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b335640bef lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5414 expref: 13 pid: 23799 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.255128:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948303542f00) 00010000:00010000:1.0:1787432942.255135:0:22704:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640c19 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.255145:0:22704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640c19 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.255153:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640c19 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.255237:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432942.255326:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1550083-39d1-481c-8177-f7494d742169+12:2403:x1874258588500096:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 280us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432942.255335:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 16 00010000:00010000:2.0:1787432942.255488:0:23799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640c19 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.255497:0:23799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640c19 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.255524:0:23799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05e00/0xca72b3b335640c20 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.255534:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05e00/0xca72b3b335640c20 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.255543:0:23799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05e00/0xca72b3b335640c20 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.256077:0:23799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640c27 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.256087:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640c27 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.256095:0:23799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640c27 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432942.256106:0:23799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787432942.256145:0:23799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640c19 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.256197:0:23799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640c19 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.256203:0:23799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640c19 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.256209:0:23799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edaa00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432942.256213:0:23799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640c19 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.256221:0:23799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640c19 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.256233:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948303542f00) 00010000:00010000:2.0:1787432942.256236:0:23799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432942.256240:0:23799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640c19 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.256245:0:23799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edaa00/0xca72b3b335640c19 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432942.256257:0:23799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a53f198e reply state 00000000e900c6c6 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05e00/0xca72b3b335640c20 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.256267:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05e00/0xca72b3b335640c20 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.256273:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff948405994a00) 00010000:00010000:2.0:1787432942.256276:0:23799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787432942.256279:0:23799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787432942.256314:0:23799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb800/0xca72b3b335640c12 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5422 expref: 15 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.256336:0:23799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640c27 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5422 expref: 14 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.256471:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:2.0:1787432942.256474:0:23799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787432942.256477:0:23799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f05400, rc 0) 00000100:00100000:2.0:1787432942.256519:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+15:18753:x1874258588499968:12345-192.168.204.24@tcp:101:bash.0 Request processed in 13410us (13616us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1787432942.256527:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 37 00000100:00100000:3.0:1787432942.280737:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432942.283215:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588500224 00000100:00100000:2.0:1787432942.283231:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588500224 00000100:00100000:2.0:1787432942.283313:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 38 00000100:00100000:2.0:1787432942.283324:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+15:18753:x1874258588500224:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787432942.283359:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432942.283385:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c35 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5429 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.283743:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640c3c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.283766:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640c3c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.283778:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640c3c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432942.283893:0:22719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787432942.283911:0:22719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432942.283941:0:22719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640c3c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.283958:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640c3c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.283984:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c35 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5429 expref: 17 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.284009:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640c3c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5429 expref: 16 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.284025:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:2.0:1787432942.284028:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432942.284032:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f05600, rc 0) 00000100:00100000:2.0:1787432942.284282:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+16:18753:x1874258588500224:12345-192.168.204.24@tcp:101:bash.0 Request processed in 958us (3558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432942.284291:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 38 00000100:00100000:1.0:1787432942.287694:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432942.287780:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588500480 00000100:00100000:2.0:1787432942.287790:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588500480 00000100:00100000:2.0:1787432942.287857:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:2.0:1787432942.287869:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:454691f5-94b0-49cf-b719-d8e9565d245e+16:18753:x1874258588500480:12345-192.168.204.24@tcp:35:bash.0 00000100:00100000:2.0:1787432942.288194:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:454691f5-94b0-49cf-b719-d8e9565d245e+17:18753:x1874258588500480:12345-192.168.204.24@tcp:35:bash.0 Request processed in 326us (508us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1787432942.288202:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:3.0:1787432942.355752:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432942.355831:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588500736 00000100:00100000:1.0:1787432942.355867:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588500736 00000100:00100000:1.0:1787432942.355937:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 39 00000100:00100000:1.0:1787432942.355950:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+17:18763:x1874258588500736:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432942.355980:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432942.356059:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5430 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432942.356300:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787432942.356417:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5430 expref: 19 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.356436:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948411a7a100) 00010000:00010000:1.0:1787432942.356439:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787432942.356445:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5430 expref: 19 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.356459:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302774c00, rc 0) 00000100:00100000:1.0:1787432942.356533:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+18:18763:x1874258588500736:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 584us (791us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1787432942.356541:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 39 00000100:00100000:3.0:1787432942.361269:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432942.362316:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588500992 00000100:00100000:1.0:1787432942.362329:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588500992 00000100:00100000:1.0:1787432942.362397:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:1.0:1787432942.362408:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:454691f5-94b0-49cf-b719-d8e9565d245e+18:18763:x1874258588500992:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:1.0:1787432942.362672:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:454691f5-94b0-49cf-b719-d8e9565d245e+19:18763:x1874258588500992:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 264us (1412us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1787432942.362680:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:3.0:1787432942.400011:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432942.408286:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588501248 00000100:00100000:1.0:1787432942.408304:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588501248 00000100:00100000:1.0:1787432942.408398:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 40 00000100:00100000:1.0:1787432942.408412:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+19:18766:x1874258588501248:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432942.408450:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432942.408476:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c51 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5437 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.408591:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640c58 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.408607:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640c58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.408620:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640c58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432942.408632:0:22720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787432942.408739:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c51 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5437 expref: 22 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.408758:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640c58 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5437 expref: 21 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.408767:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:1.0:1787432942.408770:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432942.408774:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302775000, rc 0) 00000100:00100000:1.0:1787432942.408870:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+21:18766:x1874258588501248:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 460us (8869us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1787432942.408905:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 40 00000100:00100000:3.0:1787432942.413020:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432942.413083:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432942.413214:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588501504 00000100:00100000:2.0:1787432942.413227:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588501504 00000100:00100000:2.0:1787432942.413305:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 41 00000100:00100000:2.0:1787432942.413338:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+21:18766:x1874258588501504:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:2.0:1787432942.413424:0:23799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c66 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.413446:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c66 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.413461:0:23799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c66 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.413505:0:23799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c66 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.413516:0:23799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c66 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.413522:0:23799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c66 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.413529:0:23799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f04200 already unused, calling callback (ffffffffc183f4f0) 00000100:00100000:0.0:1787432942.413529:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588501376 00000100:00100000:0.0:1787432942.413536:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588501376 00010000:00010000:2.0:1787432942.413537:0:23799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c66 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.413548:0:23799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c66 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.413562:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:2.0:1787432942.413566:0:23799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432942.413570:0:23799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c66 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.413577:0:23799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c66 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432942.413657:0:25748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:1.0:1787432942.413668:0:25748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454691f5-94b0-49cf-b719-d8e9565d245e+22:2402:x1874258588501376:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432942.413683:0:25748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432942.413703:0:25748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640c58 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5437 expref: 22 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.413733:0:25748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:1.0:1787432942.413737:0:25748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432942.413821:0:25748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454691f5-94b0-49cf-b719-d8e9565d245e+21:2402:x1874258588501376:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 154us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432942.413828:0:25748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:2.0:1787432942.414248:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+20:18766:x1874258588501504:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 915us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432942.414256:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 41 00000100:00100000:3.0:1787432942.415938:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432942.417057:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588501760 00000100:00100000:0.0:1787432942.417073:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588501760 00000100:00100000:0.0:1787432942.417202:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:0.0:1787432942.417214:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:454691f5-94b0-49cf-b719-d8e9565d245e+20:18766:x1874258588501760:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:0.0:1787432942.417481:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:454691f5-94b0-49cf-b719-d8e9565d245e+21:18766:x1874258588501760:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 268us (1554us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1787432942.417489:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 7 00000040:00080000:2.0:1787432942.604533:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787432942.727154:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432942.727338:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588502016 00000100:00100000:2.0:1787432942.727349:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588502016 00000100:00100000:2.0:1787432942.727429:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 42 00000100:00100000:2.0:1787432942.727441:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+21:18797:x1874258588502016:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787432942.727465:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432942.727486:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c6d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d543e expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.727610:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640c74 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.727626:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640c74 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.727637:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640c74 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432942.727648:0:22719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787432942.727780:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c6d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d543e expref: 24 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.727801:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640c74 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d543e expref: 23 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.727830:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:2.0:1787432942.727845:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432942.727849:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f05a00, rc 0) 00000100:00100000:2.0:1787432942.727926:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+23:18797:x1874258588502016:12345-192.168.204.24@tcp:101:cat.0 Request processed in 487us (780us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1787432942.727934:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 42 00010000:00010000:2.0:1787432942.735381:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432942.742436:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432942.742521:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432942.742952:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588502400 00000100:00100000:0.0:1787432942.742971:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588502400 00000100:00100000:0.0:1787432942.743066:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1 00000100:00100000:0.0:1787432942.743080:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:454691f5-94b0-49cf-b719-d8e9565d245e+23:2402:x1874258588502400:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432942.743098:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432942.743133:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640c74 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d543e expref: 23 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432942.743221:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:0.0:1787432942.743227:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432942.743291:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:454691f5-94b0-49cf-b719-d8e9565d245e+22:2402:x1874258588502400:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 214us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432942.743300:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1 00000100:00100000:2.0:1787432942.744419:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588502272 00000100:00100000:2.0:1787432942.744431:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588502272 00000100:00100000:2.0:1787432942.744490:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:2.0:1787432942.744502:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:454691f5-94b0-49cf-b719-d8e9565d245e+22:18797:x1874258588502272:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:2.0:1787432942.744797:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:454691f5-94b0-49cf-b719-d8e9565d245e+23:18797:x1874258588502272:12345-192.168.204.24@tcp:35:cat.0 Request processed in 297us (2376us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1787432942.744804:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:3.0:1787432942.846971:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432942.847100:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588502656 00000100:00100000:1.0:1787432942.847112:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588502656 00000100:00100000:1.0:1787432942.847225:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 43 00000100:00100000:1.0:1787432942.847236:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+23:18803:x1874258588502656:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:1.0:1787432942.847259:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432942.847279:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c82 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5445 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.847388:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640c89 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.847403:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640c89 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.847414:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640c89 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432942.847440:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787432942.847803:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640c82 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5445 expref: 26 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.847823:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640c89 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5445 expref: 25 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.847844:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:1.0:1787432942.847847:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432942.847851:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302775000, rc 0) 00000100:00100000:1.0:1787432942.847919:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+25:18803:x1874258588502656:12345-192.168.204.24@tcp:101:dd.0 Request processed in 684us (959us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1787432942.847928:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 43 00000100:00100000:3.0:1787432942.852313:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432942.852421:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588502784 00000100:00100000:2.0:1787432942.852432:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588502784 00000100:00100000:2.0:1787432942.852492:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 44 00000100:00100000:2.0:1787432942.852514:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+25:18803:x1874258588502784:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:2.0:1787432942.852549:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432942.852571:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c97 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d544c expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.852614:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640c9e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.852629:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640c9e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.852658:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640c9e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.852787:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640c97 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d544c expref: 27 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.852807:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640c9e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d544c expref: 26 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.852817:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:2.0:1787432942.852820:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787432942.852823:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f04600, rc 0) 00000100:00100000:2.0:1787432942.852900:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+26:18803:x1874258588502784:12345-192.168.204.24@tcp:101:dd.0 Request processed in 388us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432942.852908:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 44 00000100:00100000:3.0:1787432942.855789:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432942.856125:0:25748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588502912 00000100:00100000:1.0:1787432942.856135:0:25748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588502912 00000100:00100000:1.0:1787432942.856363:0:25748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:1.0:1787432942.856374:0:25748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454691f5-94b0-49cf-b719-d8e9565d245e+26:2402:x1874258588502912:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432942.856393:0:25748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432942.856420:0:25748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640c89 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5445 expref: 26 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432942.856440:0:25748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:1.0:1787432942.856445:0:25748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432942.856520:0:25748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454691f5-94b0-49cf-b719-d8e9565d245e+25:2402:x1874258588502912:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 147us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432942.856535:0:25748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:3.0:1787432942.857492:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432942.858690:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588503168 00000100:00100000:2.0:1787432942.858706:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588503168 00000100:00100000:2.0:1787432942.858784:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 45 00000100:00100000:2.0:1787432942.858796:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+25:18803:x1874258588503168:12345-192.168.204.24@tcp:36:dd.0 00010000:00010000:2.0:1787432942.858870:0:23799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432942.858902:0:23799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640c3c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5429 expref: 25 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.858925:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:2.0:1787432942.858930:0:23799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432942.859363:0:23799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640ca5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.859398:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640ca5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.859408:0:23799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640ca5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432942.859521:0:23799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1787432942.859545:0:23799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005480f885 reply state 000000007bae2678 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640ca5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.859557:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640ca5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432942.859564:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:2.0:1787432942.859567:0:23799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787432942.859570:0:23799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432942.859681:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+27:18803:x1874258588503168:12345-192.168.204.24@tcp:36:dd.0 Request processed in 885us (2192us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1787432942.859690:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 45 00000020:00080000:2.0:1787432942.859696:0:23799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787432942.919352:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432942.919636:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588503424 00000100:00100000:1.0:1787432942.919651:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588503424 00000100:00100000:1.0:1787432942.919730:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:1.0:1787432942.919744:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:454691f5-94b0-49cf-b719-d8e9565d245e+27:18803:x1874258588503424:12345-192.168.204.24@tcp:35:dd.0 00000100:00100000:1.0:1787432942.920404:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:454691f5-94b0-49cf-b719-d8e9565d245e+28:18803:x1874258588503424:12345-192.168.204.24@tcp:35:dd.0 Request processed in 658us (1059us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1787432942.920414:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:3.0:1787432943.072991:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432943.073257:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588503552 00000100:00100000:2.0:1787432943.073269:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588503552 00000100:00100000:2.0:1787432943.073350:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:2.0:1787432943.073373:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+28:18817:x1874258588503552:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:2.0:1787432943.073399:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432943.073422:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640cac lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5453 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073487:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640cb3 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073516:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640cb3 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787432943.073603:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787432943.073691:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640cb3 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073705:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fde00/0xca72b3b335640cba lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073712:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fde00/0xca72b3b335640cba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073719:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fde00/0xca72b3b335640cba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073783:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640cc1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073790:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640cc1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073797:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640cc1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432943.073844:0:22719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787432943.073849:0:22719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432943.073883:0:22719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640cc1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073895:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640cc1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073915:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640cb3 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073921:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640cb3 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073928:0:22719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640cb3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073934:0:22719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f04200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432943.073938:0:22719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640cb3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073945:0:22719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640cb3 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073956:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948303542f00) 00010000:00010000:2.0:1787432943.073958:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432943.073962:0:22719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640cb3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073968:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640cb3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073981:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fde00/0xca72b3b335640cba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073986:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fde00/0xca72b3b335640cba lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.073992:0:22719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fde00/0xca72b3b335640cba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.074001:0:22719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fde00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432943.074004:0:22719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fde00/0xca72b3b335640cba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.074010:0:22719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fde00/0xca72b3b335640cba lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.074016:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff948405994a00) 00010000:00010000:2.0:1787432943.074018:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432943.074021:0:22719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fde00/0xca72b3b335640cba lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.074026:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fde00/0xca72b3b335640cba lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.074050:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640cac lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5453 expref: 30 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.074121:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640cc1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5453 expref: 29 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.074130:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:2.0:1787432943.074132:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432943.074135:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85ec00, rc 0) 00000100:00100000:2.0:1787432943.074346:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+29:18817:x1874258588503552:12345-192.168.204.24@tcp:101:stat.0 Request processed in 976us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432943.074361:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:3.0:1787432943.136328:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432943.136518:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588503808 00000100:00100000:1.0:1787432943.136538:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588503808 00000100:00100000:1.0:1787432943.136604:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 47 00000100:00100000:1.0:1787432943.136614:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+29:18823:x1874258588503808:12345-192.168.204.24@tcp:36:truncate.0 00010000:00010000:1.0:1787432943.136669:0:22718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432943.136698:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640cc1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5453 expref: 29 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.136718:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:1.0:1787432943.136723:0:22718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432943.136916:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640cc8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.136931:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640cc8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.136941:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640cc8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787432943.136993:0:22718:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:1.0:1787432943.137019:0:22718:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c04094c reply state 00000000265a1828 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640cc8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.137054:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640cc8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.137061:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:1.0:1787432943.137063:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787432943.137066:0:22718:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787432943.137246:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+31:18823:x1874258588503808:12345-192.168.204.24@tcp:36:truncate.0 Request processed in 631us (927us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1787432943.137255:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 47 00000020:00080000:1.0:1787432943.137261:0:22718:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787432943.300081:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432943.300242:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588503936 00000100:00100000:1.0:1787432943.300253:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588503936 00000100:00100000:1.0:1787432943.300327:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 48 00000100:00100000:1.0:1787432943.300340:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+31:18837:x1874258588503936:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:1.0:1787432943.300364:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432943.300396:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640ccf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d545a expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300477:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775800/0xca72b3b335640cd6 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300491:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775800/0xca72b3b335640cd6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300510:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775800/0xca72b3b335640cd6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300536:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640cdd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300565:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640cdd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300573:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640cdd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300643:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640ce4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300650:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640ce4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300656:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640ce4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432943.300695:0:22720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1787432943.300699:0:22720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432943.300717:0:22720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640ce4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300728:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640ce4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300737:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775800/0xca72b3b335640cd6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300744:0:22720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302775800/0xca72b3b335640cd6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300751:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302775800/0xca72b3b335640cd6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300767:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432943.300772:0:22720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775800/0xca72b3b335640cd6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300778:0:22720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775800/0xca72b3b335640cd6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300790:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948303542f00) 00010000:00010000:1.0:1787432943.300793:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432943.300797:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302775800/0xca72b3b335640cd6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300803:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775800/0xca72b3b335640cd6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300817:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640cdd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300835:0:22720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640cdd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300840:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640cdd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300845:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432943.300847:0:22720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640cdd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300853:0:22720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640cdd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300872:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff948405994a00) 00010000:00010000:1.0:1787432943.300875:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432943.300878:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640cdd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300883:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640cdd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300908:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640ccf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d545a expref: 33 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300930:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640ce4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d545a expref: 32 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.300937:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:1.0:1787432943.300939:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432943.300941:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302775600, rc 0) 00000100:00100000:1.0:1787432943.301018:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+32:18837:x1874258588503936:12345-192.168.204.24@tcp:101:stat.0 Request processed in 681us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432943.301033:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 48 00000100:00100000:0.0:1787432943.388548:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432943.388610:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588504192 00000100:00100000:1.0:1787432943.388620:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588504192 00000100:00100000:1.0:1787432943.388683:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 49 00000100:00100000:1.0:1787432943.388694:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+32:18847:x1874258588504192:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432943.388715:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432943.388745:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640ceb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5461 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432943.388911:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787432943.389035:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640ceb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5461 expref: 34 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.389057:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948411a7a100) 00010000:00010000:1.0:1787432943.389060:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787432943.389066:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640ceb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5461 expref: 34 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.389087:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302774c00, rc 0) 00000100:00100000:1.0:1787432943.389212:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+33:18847:x1874258588504192:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 470us (625us total) trans 12884901910 rc 301/301 00000100:00100000:1.0:1787432943.389221:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 49 00000100:00100000:3.0:1787432943.391419:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432943.391531:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588504448 00000100:00100000:2.0:1787432943.391553:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588504448 00000100:00100000:2.0:1787432943.391612:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00100000:2.0:1787432943.391622:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303141450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:454691f5-94b0-49cf-b719-d8e9565d245e+33:18847:x1874258588504448:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:2.0:1787432943.391862:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303141450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:454691f5-94b0-49cf-b719-d8e9565d245e+34:18847:x1874258588504448:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 242us (450us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1787432943.391869:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00100000:3.0:1787432943.492249:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432943.494459:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588504704 00000100:00100000:1.0:1787432943.495755:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588504704 00000100:00100000:1.0:1787432943.496694:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 50 00000100:00100000:1.0:1787432943.496710:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+34:18853:x1874258588504704:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787432943.496735:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432943.496756:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640cf9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5468 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.496877:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.496895:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640c27 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5422 expref: 35 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.496924:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640ce4 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d545a expref: 35 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.496933:0:22720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.496969:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640ce4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d545a expref: 35 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.496984:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640ce4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d545a expref: 35 pid: 22720 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432943.496999:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22720:1874258609582336:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432943.497123:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640c27 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5422 expref: 35 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.497132:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640c27 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5422 expref: 35 pid: 23799 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432943.497214:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22720:1874258609582464:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432943.497246:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de44240 going to sleep for 11 seconds 00000100:00100000:3.0:1787432943.500773:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432943.500908:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22720:1874258609582336:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432943.500920:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22720:1874258609582464:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432943.500945:0:22720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432943.501948:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432943.503529:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588504832 00000100:00100000:0.0:1787432943.503540:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588504832 00010000:00010000:0.0:1787432943.503583:0:22704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640ce4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d545a expref: 36 pid: 22720 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432943.503648:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588504960 00000100:00100000:0.0:1787432943.503651:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588504960 00010000:00010000:0.0:1787432943.503664:0:22704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640c27 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5422 expref: 37 pid: 23799 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432943.507830:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:3.0:1787432943.507858:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435989c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:454691f5-94b0-49cf-b719-d8e9565d245e+37:2403:x1874258588504832:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432943.507886:0:22706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432943.507905:0:22706:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640ce4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d545a expref: 37 pid: 22720 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.507932:0:22706:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640ce4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d545a expref: 37 pid: 22720 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.507964:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640ce4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d545a expref: 37 pid: 22720 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.507989:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:3.0:1787432943.507996:0:22706:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.508005:0:22706:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.508012:0:22706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432943.508113:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435989c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:454691f5-94b0-49cf-b719-d8e9565d245e+36:2403:x1874258588504832:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 269us (7350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432943.508128:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:3.0:1787432943.508237:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:3.0:1787432943.508253:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:454691f5-94b0-49cf-b719-d8e9565d245e+35:2400:x1874258588504960:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432943.508262:0:22706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432943.508274:0:22706:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640c27 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5422 expref: 35 pid: 23799 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.508328:0:22706:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640c27 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5422 expref: 35 pid: 23799 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.508341:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05400/0xca72b3b335640c27 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5422 expref: 35 pid: 23799 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.508353:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:3.0:1787432943.508357:0:22706:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.508365:0:22706:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.508373:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.508422:0:22706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432943.508444:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:454691f5-94b0-49cf-b719-d8e9565d245e+34:2400:x1874258588504960:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 193us (6499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432943.508452:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 18 00010000:00010000:1.0:1787432943.508893:0:22720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.508908:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432943.508927:0:22720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1787432943.510224:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640cf9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5468 expref: 35 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.510254:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5468 expref: 34 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.510264:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:1.0:1787432943.510267:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787432943.510270:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302775c00, rc 0) 00000100:00100000:1.0:1787432943.510325:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+34:18853:x1874258588504704:12345-192.168.204.24@tcp:101:bash.0 Request processed in 13621us (18095us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1787432943.510334:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 50 00000100:00100000:3.0:1787432943.513591:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432943.513735:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588505216 00000100:00100000:1.0:1787432943.513745:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588505216 00000100:00100000:1.0:1787432943.513804:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:1.0:1787432943.513815:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+34:18853:x1874258588505216:12345-192.168.204.24@tcp:36:bash.0 00010000:00010000:1.0:1787432943.514048:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640d0e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.514078:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640d0e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.514105:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640d0e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787432943.514153:0:22718:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:1.0:1787432943.514207:0:22718:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5654776 reply state 0000000027eb2129 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640d0e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.514220:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640d0e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.514229:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:1.0:1787432943.514232:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787432943.514235:0:22718:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787432943.514320:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+37:18853:x1874258588505216:12345-192.168.204.24@tcp:36:bash.0 Request processed in 507us (739us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1787432943.514327:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 51 00000020:00080000:1.0:1787432943.514332:0:22718:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787432943.520534:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432943.520643:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588505344 00000100:00100000:2.0:1787432943.520653:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588505344 00000100:00100000:2.0:1787432943.520717:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:2.0:1787432943.520729:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+37:18853:x1874258588505344:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787432943.520756:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432943.520777:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b335640d15 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d546f expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.520847:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b335640d15 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d546f expref: 38 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.520862:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b335640d15 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d546f expref: 38 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.520883:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:2.0:1787432943.520886:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432943.520890:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e800, rc 0) 00000100:00100000:2.0:1787432943.520955:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+38:18853:x1874258588505344:12345-192.168.204.24@tcp:101:bash.0 Request processed in 228us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432943.520962:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:3.0:1787432943.525688:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432943.525801:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588505472 00000100:00100000:1.0:1787432943.525811:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588505472 00000100:00100000:1.0:1787432943.525888:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 53 00000100:00100000:1.0:1787432943.525898:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+38:18853:x1874258588505472:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787432943.525919:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432943.525939:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640d1c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5476 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.526028:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640d23 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.526043:0:22718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5468 expref: 39 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.526065:0:22718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640d23 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.526098:0:22718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5468 expref: 39 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.526111:0:22718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5468 expref: 39 pid: 22720 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432943.526126:0:22718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22718:1874258609582592:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432943.526303:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de443c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432943.529345:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432943.529537:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588505600 00000100:00100000:0.0:1787432943.529547:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588505600 00010000:00010000:0.0:1787432943.529588:0:22706:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5468 expref: 40 pid: 22720 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432943.529632:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:0.0:1787432943.529641:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:454691f5-94b0-49cf-b719-d8e9565d245e+40:2403:x1874258588505600:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432943.529655:0:22706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432943.529661:0:22706:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5468 expref: 40 pid: 22720 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432943.529688:0:22706:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5468 expref: 40 pid: 22720 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432943.529711:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:0.0:1787432943.529716:0:22706:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640d23 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432943.529726:0:22706:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640d23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432943.529734:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640d23 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432943.529752:0:22706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432943.529809:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:454691f5-94b0-49cf-b719-d8e9565d245e+40:2403:x1874258588505600:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 169us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432943.529826:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 19 00010000:00010000:1.0:1787432943.529844:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775c00/0xca72b3b335640d00 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5468 expref: 39 pid: 22720 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432943.529860:0:22718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22718:1874258609582592:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432943.529879:0:22718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640d23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.529887:0:22718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640d23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.529894:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640d23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432943.529949:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787432943.529955:0:22718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432943.529975:0:22718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640d23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.530012:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640d1c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5476 expref: 39 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.532525:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640d23 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5476 expref: 38 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432943.532540:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:1.0:1787432943.532544:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432943.532548:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302775600, rc 0) 00000100:00100000:1.0:1787432943.532627:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+38:18853:x1874258588505472:12345-192.168.204.24@tcp:101:bash.0 Request processed in 6729us (6949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432943.532636:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 53 00000100:00100000:3.0:1787432943.536149:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432943.536979:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588505856 00000100:00100000:0.0:1787432943.536990:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588505856 00000100:00100000:0.0:1787432943.537120:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:0.0:1787432943.537132:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:454691f5-94b0-49cf-b719-d8e9565d245e+38:18853:x1874258588505856:12345-192.168.204.24@tcp:103:bash.0 00010000:00010000:0.0:1787432943.537151:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787432943.537188:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b335640d15 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d546f expref: 38 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432943.537211:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775600/0xca72b3b335640d23 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5476 expref: 37 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432943.537241:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:0.0:1787432943.537246:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432943.537311:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:454691f5-94b0-49cf-b719-d8e9565d245e+36:18853:x1874258588505856:12345-192.168.204.24@tcp:103:bash.0 Request processed in 181us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432943.537319:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:0.0:1787432943.543735:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432943.544016:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588505984 00000100:00100000:2.0:1787432943.544038:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588505984 00000100:00100000:2.0:1787432943.544349:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00100000:2.0:1787432943.544365:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+36:18853:x1874258588505984:12345-192.168.204.24@tcp:58:bash.0 00010000:00010000:2.0:1787432943.544615:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640d2a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.544633:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640d2a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432943.544645:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640d2a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432943.546853:0:22719:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432943.546956:0:22719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1787432943.547085:0:22719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1787432943.547496:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+36:18853:x1874258588505984:12345-192.168.204.24@tcp:58:bash.0 Request processed in 3120us (3755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432943.547508:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00100000:2.0:1787432943.553062:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432943.553242:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588506112 00000100:00100000:3.0:1787432943.553251:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588506112 00000100:00100000:3.0:1787432943.553372:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:3.0:1787432943.553399:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+36:18853:x1874258588506112:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787432943.553423:0:23799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432943.553443:0:23799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b335640d31 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d547d expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.553521:0:23799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640d2a lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.553533:0:23799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b335640d31 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d547d expref: 37 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.553552:0:23799:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640d2a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.553566:0:23799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b335640d31 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d547d expref: 37 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.553581:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:3.0:1787432943.553584:0:23799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787432943.553588:0:23799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b335640d31 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d547d expref: 37 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432943.553597:0:23799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0600, rc 0) 00000100:00100000:3.0:1787432943.553678:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+37:18853:x1874258588506112:12345-192.168.204.24@tcp:101:bash.0 Request processed in 281us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432943.553686:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:0.0:1787432943.564329:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432943.564362:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483036e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609582720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432943.564437:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432943.564496:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609582720 00000100:00100000:0.0:1787432943.564504:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609582720 00000100:00100000:0.0:1787432943.564732:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787432943.564744:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609582720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787432943.564773:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787432943.564834:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609582720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432943.564841:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787432943.564863:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432943.564895:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483036e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609582720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432943.565452:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609583104:0@lo:400:kworker.0 00000100:00100000:1.0:1787432943.565504:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432943.565531:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609583616:0@lo:400:kworker.0 00000100:00100000:1.0:1787432943.565554:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432943.565570:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609584128:0@lo:400:kworker.0 00000100:00100000:1.0:1787432943.565593:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432943.565612:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787432943.565617:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a13c04c-dd5b-4f06-b031-814868f35d81:3642:1874258609582976:0@lo:400:kworker.0 00000100:00100000:1.0:1787432943.565644:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432943.565668:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609583488:0@lo:400:kworker.0 00000100:00100000:1.0:1787432943.565692:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432943.565710:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609584000:0@lo:400:kworker.0 00000100:00100000:1.0:1787432943.565750:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432943.565776:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609583104 00000100:00100000:1.0:1787432943.565781:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609583104 00000100:00100000:1.0:1787432943.565808:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609583616 00000100:00100000:1.0:1787432943.565811:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609583616 00000100:00100000:1.0:1787432943.565840:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787432943.565848:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609583104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432943.565892:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609583104:12345-0@lo:400:kworker.0 Request processed in 45us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432943.565899:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787432943.565912:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787432943.565919:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609583616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432943.565948:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609583616:12345-0@lo:400:kworker.0 Request processed in 29us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432943.565954:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787432943.565995:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609583104:0@lo:400:kworker.0 00000100:00100000:1.0:1787432943.566007:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609583616:0@lo:400:kworker.0 00000100:00100000:1.0:1787432943.566032:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609584128 00000100:00100000:1.0:1787432943.566035:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609584128 00000100:00100000:1.0:1787432943.566066:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609583488 00000100:00100000:1.0:1787432943.566069:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609583488 00000100:00100000:1.0:1787432943.566079:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609584000 00000100:00100000:1.0:1787432943.566081:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609584000 00000100:00100000:1.0:1787432943.566095:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787432943.566101:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609584128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432943.566135:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609584128:12345-0@lo:400:kworker.0 Request processed in 35us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432943.566152:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787432943.566190:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787432943.566197:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609583488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432943.566227:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609583488:12345-0@lo:400:kworker.0 Request processed in 30us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432943.566232:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787432943.566243:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787432943.566249:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609584000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432943.566275:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609584000:12345-0@lo:400:kworker.0 Request processed in 27us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432943.566281:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787432943.566297:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432943.566300:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432943.566316:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609583488:0@lo:400:kworker.0 00000100:00100000:1.0:1787432943.566325:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609584000:0@lo:400:kworker.0 00010000:00080000:1.0:1787432943.566335:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94840356a300 x1874258609584128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432943.566345:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609584128:0@lo:400:kworker.0 00000100:00100000:3.0:1787432943.568321:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609583232:0@lo:400:kworker.0 00000100:00100000:3.0:1787432943.568396:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432943.568441:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609583744:0@lo:400:kworker.0 00000100:00100000:3.0:1787432943.568461:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432943.568489:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609584256:0@lo:400:kworker.0 00000100:00100000:3.0:1787432943.568517:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432943.568537:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787432943.568542:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609582848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432943.568560:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432943.568575:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609583360:0@lo:400:kworker.0 00000100:00100000:3.0:1787432943.568591:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432943.568603:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609583872:0@lo:400:kworker.0 00000100:00100000:3.0:1787432943.568618:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432943.568630:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609584384:0@lo:400:kworker.0 00000100:00100000:3.0:1787432943.568645:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432943.568674:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609583232 00000100:00100000:3.0:1787432943.568680:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609583232 00000100:00100000:3.0:1787432943.568724:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609583744 00000100:00100000:3.0:1787432943.568726:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609583744 00000100:00100000:3.0:1787432943.568737:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609583360 00000100:00100000:3.0:1787432943.568739:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609583360 00000100:00100000:3.0:1787432943.568753:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787432943.568771:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609583232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432943.568814:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609583232:12345-0@lo:400:kworker.0 Request processed in 53us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432943.568830:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787432943.568848:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787432943.568854:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609583744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432943.568888:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609583744:12345-0@lo:400:kworker.0 Request processed in 34us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432943.568893:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787432943.568903:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787432943.568909:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609583360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432943.568928:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609583360:12345-0@lo:400:kworker.0 Request processed in 20us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432943.568933:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787432943.568951:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432943.568954:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432943.568962:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609582848 00000100:00100000:3.0:1787432943.568965:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609582848 00000100:00100000:3.0:1787432943.569276:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787432943.569285:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609582848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432943.569304:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787432943.569333:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609582848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432943.569339:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787432943.569436:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609582848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432943.569445:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609583360:0@lo:400:kworker.0 00000100:00100000:3.0:1787432943.569454:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609583232:0@lo:400:kworker.0 00000100:00100000:3.0:1787432943.569461:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609583744:0@lo:400:kworker.0 00000100:00100000:3.0:1787432943.569675:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609584256 00000100:00100000:3.0:1787432943.569680:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609584256 00000100:00080000:3.0:1787432943.569697:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432943.569722:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609583872 00000100:00100000:3.0:1787432943.569724:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609583872 00000100:00100000:3.0:1787432943.569733:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609584384 00000100:00100000:3.0:1787432943.569735:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609584384 00000100:00080000:3.0:1787432943.569745:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432943.569756:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787432943.569878:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609582976 00000100:00100000:0.0:1787432943.569882:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609582976 00000100:00100000:0.0:1787432943.569907:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787432943.569913:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:3642:x1874258609582976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432943.569952:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a13c04c-dd5b-4f06-b031-814868f35d81+24:3642:x1874258609582976:12345-0@lo:400:kworker.0 Request processed in 39us (4307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432943.569966:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787432943.570010:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787432943.570017:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609583872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432943.570053:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609583872:12345-0@lo:400:kworker.0 Request processed in 36us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432943.570059:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787432943.570071:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787432943.570077:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609584384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432943.570100:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609584384:12345-0@lo:400:kworker.0 Request processed in 24us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432943.570106:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787432943.570329:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a13c04c-dd5b-4f06-b031-814868f35d81:3642:1874258609582976:0@lo:400:kworker.0 00000100:00100000:0.0:1787432943.571974:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609583872:0@lo:400:kworker.0 00010000:00080000:0.0:1787432943.571992:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94840356a680 x1874258609584384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432943.572002:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609584384:0@lo:400:kworker.0 00000100:00100000:3.0:1787432943.572467:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609584256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432943.572469:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609584512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432943.572532:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432943.572549:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609584256:12345-0@lo:400:kworker.0 Request processed in 2788us (4038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432943.572560:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787432943.572591:0:24229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609584512 00000100:00100000:3.0:1787432943.572597:0:24229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609584512 00000100:00100000:2.0:1787432943.572896:0:24229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787432943.572908:0:24229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609584512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432943.572924:0:24229:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787432943.572972:0:24229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609584512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432943.572978:0:24229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787432943.573043:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609584512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432943.573750:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609584256:0@lo:400:kworker.0 00010000:00010000:1.0:1787432943.755404:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787432944.203411:0:22754:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787432944.203421:0:22754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432944.203449:0:22754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1787432944.203457:0:22754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787432944.203615:0:22754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d25180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22754:1874258609584640:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787432944.204136:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840981d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787432944.226327:0:22754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d25180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22754:1874258609584640:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787432944.230320:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432944.231901:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588506240 00000100:00100000:2.0:1787432944.231916:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588506240 00000100:00100000:2.0:1787432944.231993:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 56 00000100:00100000:2.0:1787432944.232004:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+37:18855:x1874258588506240:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787432944.232050:0:22719:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787432944.232231:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+37:18855:x1874258588506240:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 228us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432944.232239:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 56 00000100:00100000:2.0:1787432944.238724:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432944.238924:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588506368 00000100:00100000:0.0:1787432944.238936:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588506368 00000100:00100000:0.0:1787432944.239009:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 57 00000100:00100000:0.0:1787432944.239022:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+37:18855:x1874258588506368:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787432944.239126:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb400/0xca72b3b335640d38 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239143:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb400/0xca72b3b335640d38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239157:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb400/0xca72b3b335640d38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239205:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d3f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239214:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239221:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239243:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d46 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239253:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239259:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432944.239304:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787432944.239309:0:22718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787432944.239322:0:22718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239334:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb400/0xca72b3b335640d38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239347:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb400/0xca72b3b335640d38 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239354:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb400/0xca72b3b335640d38 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239359:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edb400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432944.239363:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb400/0xca72b3b335640d38 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239371:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb400/0xca72b3b335640d38 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239385:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948303542100) 00010000:00010000:0.0:1787432944.239388:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432944.239392:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb400/0xca72b3b335640d38 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239398:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb400/0xca72b3b335640d38 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239411:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239418:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d3f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239424:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239429:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edae00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432944.239441:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239448:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d3f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239457:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff948411a7a200) 00010000:00010000:0.0:1787432944.239460:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432944.239462:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d3f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239469:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d3f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239484:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239489:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d46 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239494:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d46 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239513:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301eda600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432944.239517:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d46 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239523:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d46 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239531:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:0.0:1787432944.239533:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432944.239543:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d46 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.239549:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d46 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432944.239635:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+37:18855:x1874258588506368:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 614us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432944.239644:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 57 00000100:00100000:3.0:1787432944.242787:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432944.243006:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588506624 00000100:00100000:0.0:1787432944.243016:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588506624 00000100:00100000:0.0:1787432944.243089:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 58 00000100:00100000:0.0:1787432944.243100:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+37:18855:x1874258588506624:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432944.243122:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432944.243143:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d4d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5484 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.243269:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb200/0xca72b3b335640d54 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.243286:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb200/0xca72b3b335640d54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.243298:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb200/0xca72b3b335640d54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432944.243310:0:22720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787432944.243387:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb200/0xca72b3b335640d54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.243395:0:22720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb200/0xca72b3b335640d54 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.243416:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb200/0xca72b3b335640d54 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.243422:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edb200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432944.243427:0:22720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb200/0xca72b3b335640d54 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.243434:0:22720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb200/0xca72b3b335640d54 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.243448:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:0.0:1787432944.243451:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787432944.243456:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb200/0xca72b3b335640d54 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.243462:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb200/0xca72b3b335640d54 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.243517:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d4d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5484 expref: 39 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.243528:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948303542100) 00010000:00010000:0.0:1787432944.243531:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787432944.243535:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d4d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5484 expref: 39 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.243545:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301edac00, rc 0) 00000100:00100000:0.0:1787432944.243610:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+38:18855:x1874258588506624:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 511us (831us total) trans 12884901915 rc 301/301 00000100:00100000:0.0:1787432944.243627:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 58 00000100:00100000:1.0:1787432944.247284:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432944.247377:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588506752 00000100:00100000:0.0:1787432944.247387:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588506752 00000100:00100000:0.0:1787432944.247447:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00100000:0.0:1787432944.247459:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+38:18855:x1874258588506752:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787432944.247499:0:22718:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787432944.247639:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+38:18855:x1874258588506752:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 181us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432944.247647:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00100000:2.0:1787432944.251645:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432944.251746:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588507008 00000100:00100000:0.0:1787432944.251764:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588507008 00000100:00100000:0.0:1787432944.251836:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00100000:0.0:1787432944.251847:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+38:18855:x1874258588507008:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432944.251866:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432944.251885:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d62 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d548b expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787432944.252340:0:22720:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:0.0:1787432944.252349:0:22720:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:0.0:1787432944.252372:0:22720:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:0.0:1787432944.252518:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb200/0xca72b3b335640d69 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.252532:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb200/0xca72b3b335640d69 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.252542:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb200/0xca72b3b335640d69 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.252607:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d62 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d548b expref: 41 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.252625:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb200/0xca72b3b335640d69 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d548b expref: 40 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.252635:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948411a7a200) 00010000:00010000:0.0:1787432944.252638:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432944.252641:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301edb200, rc 0) 00000100:00100000:0.0:1787432944.252695:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+40:18855:x1874258588507008:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 850us (1058us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1787432944.252702:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00100000:1.0:1787432944.259820:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432944.260373:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588507264 00000100:00100000:0.0:1787432944.260385:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588507264 00000100:00100000:0.0:1787432944.260449:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:0.0:1787432944.260461:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+40:18855:x1874258588507264:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787432944.260524:0:22718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432944.260554:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb200/0xca72b3b335640d69 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d548b expref: 40 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260573:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948411a7a200) 00010000:00010000:0.0:1787432944.260584:0:22718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432944.260607:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d77 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260619:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d77 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260637:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d77 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260650:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d7e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xf971347c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260657:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d7e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xf971347c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260663:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d7e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xf971347c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260721:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d77 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260729:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d77 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260734:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d77 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260740:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301eda600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432944.260744:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d77 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260761:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d77 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260772:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948303542f00) 00010000:00010000:0.0:1787432944.260774:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432944.260778:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d77 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260794:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301eda600/0xca72b3b335640d77 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260813:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d7e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xf971347c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260820:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d7e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xf971347c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260825:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d7e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xf971347c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260829:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edae00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432944.260832:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d7e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xf971347c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260838:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d7e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xf971347c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260846:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xf971347c (ffff948411a7a800) 00010000:00010000:0.0:1787432944.260849:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432944.260851:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d7e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xf971347c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.260856:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640d7e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xf971347c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432944.260934:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+39:18855:x1874258588507264:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 475us (1136us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787432944.260942:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:1.0:1787432944.271961:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432944.272087:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588507392 00000100:00100000:0.0:1787432944.272100:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588507392 00000100:00100000:0.0:1787432944.272203:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 62 00000100:00100000:0.0:1787432944.272214:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+39:18855:x1874258588507392:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432944.272247:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432944.272274:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d85 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5492 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.272336:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb400/0xca72b3b335640d8c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.272351:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb400/0xca72b3b335640d8c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.272363:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb400/0xca72b3b335640d8c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.272481:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d85 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5492 expref: 41 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.272512:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edb400/0xca72b3b335640d8c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5492 expref: 40 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.272521:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948411a7a500) 00010000:00010000:0.0:1787432944.272524:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787432944.272528:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301edb400, rc 0) 00000100:00100000:0.0:1787432944.272596:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+40:18855:x1874258588507392:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 383us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432944.272603:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 62 00000100:00100000:1.0:1787432944.276562:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432944.276660:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588507648 00000100:00100000:3.0:1787432944.276672:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588507648 00000100:00100000:3.0:1787432944.276749:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 63 00000100:00100000:3.0:1787432944.276770:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+40:18855:x1874258588507648:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787432944.276883:0:23799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b335640d93 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.276900:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b335640d93 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.276939:0:23799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b335640d93 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787432944.277158:0:23799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:3.0:1787432944.277212:0:23799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 755369046864ns, next at 756369043954ns, rc = 0 00000004:00010000:3.0:1787432944.277269:0:23799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005831393f reply state 000000006298d3c1 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b335640d93 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.277283:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b335640d93 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.277291:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948411a7a500) 00010000:00010000:3.0:1787432944.277293:0:23799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787432944.277297:0:23799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787432944.277395:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+42:18855:x1874258588507648:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 626us (842us total) trans 12884901917 rc 0/0 00000100:00100000:3.0:1787432944.277403:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 63 00000100:00100000:1.0:1787432944.291452:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432944.291602:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588507776 00000100:00100000:0.0:1787432944.291613:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588507776 00000100:00100000:0.0:1787432944.291681:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 64 00000100:00100000:0.0:1787432944.291703:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+42:18855:x1874258588507776:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432944.291738:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432944.291770:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d9a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5499 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.291840:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d9a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5499 expref: 43 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.291856:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d9a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5499 expref: 43 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.291876:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948411a7a500) 00010000:00010000:0.0:1787432944.291879:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787432944.291882:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301edac00, rc 0) 00000100:00100000:0.0:1787432944.292445:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+43:18855:x1874258588507776:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 752us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432944.292453:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 64 00000100:00100000:1.0:1787432944.300859:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432944.301020:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588507904 00000100:00100000:3.0:1787432944.301032:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588507904 00000100:00100000:3.0:1787432944.301246:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 26 00000100:00100000:3.0:1787432944.301258:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:454691f5-94b0-49cf-b719-d8e9565d245e+5:2403:x1874258588507904:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787432944.301638:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:454691f5-94b0-49cf-b719-d8e9565d245e+6:2403:x1874258588507904:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 381us (787us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1787432944.301647:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 26 00000100:00080000:0.0:1787432944.307837:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432944.310933:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432944.311084:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588508160 00000100:00100000:1.0:1787432944.311095:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588508160 00000100:00100000:1.0:1787432944.311183:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 11 00000100:00100000:1.0:1787432944.311196:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:454691f5-94b0-49cf-b719-d8e9565d245e+43:18855:x1874258588508160:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787432944.311407:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:454691f5-94b0-49cf-b719-d8e9565d245e+44:18855:x1874258588508160:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 214us (484us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1787432944.311415:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 11 00000100:00100000:1.0:1787432944.317424:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432944.317595:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588508416 00000100:00100000:3.0:1787432944.317607:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588508416 00000100:00100000:3.0:1787432944.317717:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 65 00000100:00100000:3.0:1787432944.317728:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+44:18855:x1874258588508416:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787432944.317889:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+44:18855:x1874258588508416:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 162us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432944.317898:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 65 00000100:00100000:0.0:1787432944.325298:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432944.325379:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588508544 00000100:00100000:3.0:1787432944.325390:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588508544 00000100:00100000:3.0:1787432944.329349:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 66 00000100:00100000:3.0:1787432944.329384:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+44:18855:x1874258588508544:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432944.329409:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432944.329434:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b335640da1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d54a0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.329523:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640da8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.329539:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640da8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.329552:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640da8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432944.329608:0:22719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432944.329628:0:22719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640da8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.329658:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b335640da1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54a0 expref: 46 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.329677:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640da8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54a0 expref: 45 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.329710:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948411a7a500) 00010000:00010000:3.0:1787432944.329712:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787432944.329716:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0000, rc 0) 00000100:00100000:3.0:1787432944.330973:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+45:18855:x1874258588508544:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1598us (5676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432944.330986:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 66 00000100:00100000:2.0:1787432944.338029:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432944.338726:0:25334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588508672 00000100:00100000:3.0:1787432944.338737:0:25334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588508672 00000100:00100000:3.0:1787432944.338829:0:25334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 27 00000100:00100000:3.0:1787432944.338841:0:25334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:454691f5-94b0-49cf-b719-d8e9565d245e+6:2402:x1874258588508672:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432944.338860:0:25334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432944.338884:0:25334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e4d2fef/0xca72b3b335640daf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d54a7 expref: -99 pid: 25334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432944.338910:0:25334:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a0fef, blocks: 0x0 00010000:00010000:3.0:1787432944.338936:0:25334:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=755s v=(0 0) 00010000:00010000:3.0:1787432944.338952:0:25334:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432944.338962:0:25334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e4d2fef/0xca72b3b335640daf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54a7 expref: 7 pid: 25334 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.338985:0:25334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e4d2fef/0xca72b3b335640daf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54a7 expref: 7 pid: 25334 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.339000:0:25334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f1e00, rc 0) 00000100:00100000:3.0:1787432944.339093:0:25334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:454691f5-94b0-49cf-b719-d8e9565d245e+7:2402:x1874258588508672:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 253us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432944.339100:0:25334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 27 00000100:00100000:1.0:1787432944.343770:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432944.343973:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588508928 00000100:00100000:0.0:1787432944.343984:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588508928 00000100:00100000:0.0:1787432944.344060:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00100000:0.0:1787432944.344071:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+45:18855:x1874258588508928:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787432944.344393:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+45:18855:x1874258588508928:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 322us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432944.344415:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00100000:0.0:1787432944.348418:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432944.348590:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588509056 00000100:00100000:1.0:1787432944.348600:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588509056 00000100:00100000:1.0:1787432944.348695:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 68 00000100:00100000:1.0:1787432944.348707:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+45:18855:x1874258588509056:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787432944.351295:0:22699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1787432944.351310:0:22699:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787432944.351373:0:22699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1787432944.351491:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948302691e00/0xca72b3b335640bc5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.351516:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302691e00/0xca72b3b335640bc5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.351524:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302691e00/0xca72b3b335640bc5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.351531:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302691e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432944.351536:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302691e00/0xca72b3b335640bc5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.351553:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302691e00/0xca72b3b335640bc5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.351572:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948303542f00) 00010000:00010000:1.0:1787432944.351575:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787432944.351580:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302691e00/0xca72b3b335640bc5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.351587:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302691e00/0xca72b3b335640bc5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432944.352424:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+20:18855:x1874258588509056:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 3044us (3340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432944.352438:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 68 00000100:00100000:2.0:1787432944.352664:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432944.352679:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483036e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609584768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787432944.352736:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432944.352924:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609584768 00000100:00100000:0.0:1787432944.352932:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609584768 00000100:00100000:0.0:1787432944.352988:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787432944.352997:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609584768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787432944.353465:0:24227:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787432944.353470:0:24227:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787432944.353473:0:24227:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787432944.353475:0:24227:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787432943 -> 1787432943 00002000:00010000:0.0:1787432944.353478:0:24227:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787432944.353518:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609584768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 521us (782us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1787432944.353525:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:2.0:1787432944.353603:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9483036e1c00/2, rc 0, transno 12884901892 00000100:00100000:2.0:1787432944.353610:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483036e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609584768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787432944.356659:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:2.0:1787432944.356795:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640b39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.356823:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640b39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.356832:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640b39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.356839:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432944.356845:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640b39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.356863:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640b39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.356881:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff948303542200) 00010000:00010000:2.0:1787432944.356884:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432944.356888:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640b39 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.356894:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774e00/0xca72b3b335640b39 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.356914:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b40 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.356920:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b40 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.356927:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b40 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.356932:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432944.356935:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b40 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.356954:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b40 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.356962:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948303542f00) 00010000:00010000:2.0:1787432944.356964:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432944.356967:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b40 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.356979:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774000/0xca72b3b335640b40 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.356994:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05e00/0xca72b3b335640c20 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357001:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05e00/0xca72b3b335640c20 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357007:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05e00/0xca72b3b335640c20 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357012:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f05e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432944.357015:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05e00/0xca72b3b335640c20 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357021:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05e00/0xca72b3b335640c20 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357028:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff948405994a00) 00010000:00010000:2.0:1787432944.357031:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432944.357034:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05e00/0xca72b3b335640c20 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357049:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05e00/0xca72b3b335640c20 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357065:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640ca5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357071:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640ca5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357084:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640ca5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357089:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f05a00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432944.357092:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640ca5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357098:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640ca5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357105:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:2.0:1787432944.357108:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432944.357110:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640ca5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357116:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b335640ca5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357126:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640cc8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357131:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640cc8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357137:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640cc8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357141:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432944.357144:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640cc8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357159:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640cc8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357193:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:2.0:1787432944.357196:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432944.357199:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640cc8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357205:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302775000/0xca72b3b335640cc8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357218:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640d0e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357224:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640d0e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357229:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640d0e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357234:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432944.357237:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640d0e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357243:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640d0e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357250:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:2.0:1787432944.357251:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432944.357254:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640d0e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357269:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774600/0xca72b3b335640d0e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357281:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b335640d93 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357287:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b335640d93 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357293:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b335640d93 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357298:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432944.357300:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b335640d93 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357306:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b335640d93 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357315:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948411a7a500) 00010000:00010000:2.0:1787432944.357317:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787432944.357320:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b335640d93 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.357325:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b335640d93 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432944.357712:0:25334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588509184 00000100:00100000:3.0:1787432944.357722:0:25334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588509184 00000100:00100000:3.0:1787432944.357791:0:25334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 29 00000100:00100000:3.0:1787432944.357813:0:25334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:454691f5-94b0-49cf-b719-d8e9565d245e+7:2403:x1874258588509184:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787432944.357914:0:25334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:454691f5-94b0-49cf-b719-d8e9565d245e+7:2403:x1874258588509184:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 114us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432944.357921:0:25334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 29 00000100:00100000:2.0:1787432944.362050:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432944.362278:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588509440 00000100:00100000:3.0:1787432944.362286:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588509440 00000100:00100000:3.0:1787432944.362348:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:3.0:1787432944.362359:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+14:18855:x1874258588509440:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787432944.362415:0:23799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432944.362442:0:23799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640da8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54a0 expref: 14 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.362460:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948411a7a500) 00010000:00010000:3.0:1787432944.362465:0:23799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432944.362494:0:23799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b335640db6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.362519:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b335640db6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.362529:0:23799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b335640db6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432944.362668:0:23799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002df30a16 reply state 000000007009c05a transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b335640db6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.362681:0:23799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b335640db6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.362687:0:23799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948411a7a500) 00010000:00010000:3.0:1787432944.362690:0:23799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787432944.362692:0:23799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787432944.363152:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+15:18855:x1874258588509440:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 793us (1111us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1787432944.363160:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:0.0:1787432944.367524:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432944.367599:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588509568 00000100:00100000:3.0:1787432944.367608:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588509568 00000100:00100000:3.0:1787432944.367668:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:3.0:1787432944.367680:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:454691f5-94b0-49cf-b719-d8e9565d245e+7:18855:x1874258588509568:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432944.367698:0:24225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432944.367717:0:24225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c034448/0xca72b3b335640dbd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d54ae expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.367926:0:24225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e4d2fef/0xca72b3b335640daf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54a7 expref: 8 pid: 25334 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.367938:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432944.367942:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432944.367948:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c034448/0xca72b3b335640dbd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54ae expref: 8 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.368010:0:24225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e4d2fef/0xca72b3b335640daf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54a7 expref: 8 pid: 25334 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.368023:0:24225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e4d2fef/0xca72b3b335640daf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54a7 expref: 8 pid: 25334 timeout: 855 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432944.368048:0:24225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24225:1874258609584896:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432944.368139:0:24225:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412279300 going to sleep for 11 seconds 00000100:00100000:1.0:1787432944.371557:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432944.372404:0:24225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24225:1874258609584896:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432944.372439:0:24225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c034448/0xca72b3b335640dbd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54ae expref: 8 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.372459:0:24225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0400, rc 0) 00000100:00100000:3.0:1787432944.372525:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:454691f5-94b0-49cf-b719-d8e9565d245e+8:18855:x1874258588509568:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 4847us (5012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432944.372534:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:0.0:1787432944.373973:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588509696 00000100:00100000:0.0:1787432944.373984:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588509696 00010000:00010000:1.0:1787432944.374387:0:22706:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e4d2fef/0xca72b3b335640daf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54a7 expref: 8 pid: 25334 timeout: 855 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432944.374469:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:1.0:1787432944.374480:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:454691f5-94b0-49cf-b719-d8e9565d245e+8:2402:x1874258588509696:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432944.374510:0:22706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432944.374530:0:22706:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e4d2fef/0xca72b3b335640daf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54a7 expref: 8 pid: 25334 timeout: 855 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.374545:0:22706:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e4d2fef/0xca72b3b335640daf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54a7 expref: 8 pid: 25334 timeout: 855 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.374585:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e4d2fef/0xca72b3b335640daf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54a7 expref: 8 pid: 25334 timeout: 855 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.374600:0:22706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432944.374605:0:22706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432944.374611:0:22706:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c034448/0xca72b3b335640dbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54ae expref: 7 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.374622:0:22706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c034448/0xca72b3b335640dbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54ae expref: 7 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.374661:0:22706:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007c034448/0xca72b3b335640dbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54ae expref: 7 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432944.374675:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22706:1874258609585024:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787432944.374867:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de44e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432944.379776:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432944.379918:0:25334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588509824 00000100:00100000:0.0:1787432944.379929:0:25334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588509824 00000100:00100000:3.0:1787432944.379954:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22706:1874258609585024:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787432944.379980:0:22706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432944.380004:0:25334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00100000:0.0:1787432944.380016:0:25334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:454691f5-94b0-49cf-b719-d8e9565d245e+8:2402:x1874258588509824:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787432944.380084:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:454691f5-94b0-49cf-b719-d8e9565d245e+8:2402:x1874258588509696:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 5605us (8537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432944.380094:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 20 00002000:00010000:0.0:1787432944.380187:0:25334:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787432944.380192:0:25334:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787432943 00002000:00010000:0.0:1787432944.380195:0:25334:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787432941 00002000:00010000:0.0:1787432944.380198:0:25334:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787432943 -> 1787432943 00002000:00010000:0.0:1787432944.380201:0:25334:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787432944.380239:0:25334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:454691f5-94b0-49cf-b719-d8e9565d245e+8:2402:x1874258588509824:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 226us (474us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1787432944.380247:0:25334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00100000:3.0:1787432944.382440:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432944.383002:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588509952 00000100:00100000:0.0:1787432944.383012:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588509952 00000100:00100000:1.0:1787432944.383525:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 32 00000100:00100000:1.0:1787432944.383539:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:454691f5-94b0-49cf-b719-d8e9565d245e+8:2402:x1874258588509952:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787432944.383583:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b335640dc4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.383603:0:24227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c034448/0xca72b3b335640dbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54ae expref: 8 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.383631:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432944.383636:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432944.383641:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b335640dc4 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.383677:0:24227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c034448/0xca72b3b335640dbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54ae expref: 8 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.383690:0:24227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c034448/0xca72b3b335640dbd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54ae expref: 8 pid: 24225 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432944.383706:0:24227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24227:1874258609585152:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432944.387200:0:24227:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de44540 going to sleep for 11 seconds 00000100:00100000:2.0:1787432944.399420:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432944.399446:0:24227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24227:1874258609585152:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432944.399477:0:24227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b335640dc4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432944.399609:0:25748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588510080 00000100:00100000:3.0:1787432944.399628:0:25748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588510080 00010000:00010000:3.0:1787432944.399667:0:25748:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c034448/0xca72b3b335640dbd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54ae expref: 9 pid: 24225 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432944.399708:0:25748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:3.0:1787432944.399718:0:25748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454691f5-94b0-49cf-b719-d8e9565d245e+9:2402:x1874258588510080:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432944.399732:0:25748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432944.399752:0:25748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c034448/0xca72b3b335640dbd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54ae expref: 9 pid: 24225 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.399766:0:25748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c034448/0xca72b3b335640dbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54ae expref: 9 pid: 24225 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.399789:0:25748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c034448/0xca72b3b335640dbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54ae expref: 9 pid: 24225 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.399815:0:25748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787432944.399819:0:25748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787432944.399826:0:25748:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b335640dc4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.399836:0:25748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b335640dc4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.399866:0:25748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432944.399929:0:25748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454691f5-94b0-49cf-b719-d8e9565d245e+8:2402:x1874258588510080:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 211us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432944.399955:0:25748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 21 00010000:00010000:1.0:1787432944.400125:0:24227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b335640dc4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.400145:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b335640dc4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.400193:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b335640dc4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.400208:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b335640dc4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.400215:0:24227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b335640dc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.400222:0:24227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302775c00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432944.400227:0:24227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b335640dc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.400236:0:24227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b335640dc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.400248:0:24227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b335640dc4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.400256:0:24227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3d92fdc/0xca72b3b335640dc4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432944.400305:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:454691f5-94b0-49cf-b719-d8e9565d245e+7:2402:x1874258588509952:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 16768us (17870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432944.400313:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 32 00000100:00100000:2.0:1787432944.412507:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432944.412589:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588510336 00000100:00100000:3.0:1787432944.412599:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588510336 00000100:00100000:3.0:1787432944.412659:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00100000:3.0:1787432944.412670:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+15:18855:x1874258588510336:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787432944.412756:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b335640dcb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.412773:0:22719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640c9e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d544c expref: 15 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.412783:0:22719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b335640dcb lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.412831:0:22719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640c9e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d544c expref: 15 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.412845:0:22719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640c9e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d544c expref: 15 pid: 22719 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432944.412859:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405941880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22719:1874258609585280:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432944.412942:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412279300 going to sleep for 11 seconds 00000100:00100000:2.0:1787432944.417742:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432944.417993:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588510464 00000100:00100000:0.0:1787432944.418004:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588510464 00010000:00010000:0.0:1787432944.418114:0:22705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640c9e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d544c expref: 16 pid: 22719 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432944.418389:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405941880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22719:1874258609585280:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432944.418413:0:22719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b335640dcb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432944.418622:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:1.0:1787432944.418635:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:454691f5-94b0-49cf-b719-d8e9565d245e+16:2403:x1874258588510464:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432944.418664:0:22705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432944.418672:0:22705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640c9e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d544c expref: 16 pid: 22719 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.418685:0:22705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640c9e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d544c expref: 16 pid: 22719 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.418706:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640c9e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d544c expref: 16 pid: 22719 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.418721:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:1.0:1787432944.418727:0:22705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b335640d31 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d547d expref: 15 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.418735:0:22705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b335640dcb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.418743:0:22705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b335640dcb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.418749:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b335640dcb lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.418766:0:22705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432944.418832:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:454691f5-94b0-49cf-b719-d8e9565d245e+15:2403:x1874258588510464:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 201us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432944.418840:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 22 00010000:00010000:2.0:1787432944.420020:0:22719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b335640dcb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.420387:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b335640dcb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.420704:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dd2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.420724:0:22719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d9a lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5499 expref: 15 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.420732:0:22719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dd2 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.420772:0:22719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d9a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5499 expref: 15 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.420789:0:22719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d9a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5499 expref: 15 pid: 22720 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432944.420817:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22719:1874258609585408:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432944.420944:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1840 going to sleep for 11 seconds 00000100:00100000:2.0:1787432944.426570:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432944.426713:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22719:1874258609585408:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432944.426741:0:22719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dd2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432944.426824:0:25748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588510592 00000100:00100000:3.0:1787432944.426840:0:25748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588510592 00010000:00010000:3.0:1787432944.426875:0:25748:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d9a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5499 expref: 16 pid: 22720 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432944.426950:0:25748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:3.0:1787432944.426961:0:25748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948411a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454691f5-94b0-49cf-b719-d8e9565d245e+16:2403:x1874258588510592:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432944.426975:0:25748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432944.426983:0:25748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d9a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5499 expref: 16 pid: 22720 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.426996:0:25748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d9a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5499 expref: 16 pid: 22720 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.427019:0:25748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edac00/0xca72b3b335640d9a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5499 expref: 16 pid: 22720 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.427356:0:25748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948411a7a500) 00010000:00010000:3.0:1787432944.427362:0:25748:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dd2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.427372:0:25748:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dd2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.427380:0:25748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dd2 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.427455:0:25748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432944.427533:0:25748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948411a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:454691f5-94b0-49cf-b719-d8e9565d245e+15:2403:x1874258588510592:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 572us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432944.427550:0:25748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 23 00010000:00010000:2.0:1787432944.429253:0:22719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dd2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.429267:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dd2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432944.429386:0:22719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1787432944.429605:0:22719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1787432944.429643:0:22719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1787432944.429727:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22719:1874258609585536:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787432944.429790:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432944.429893:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432944.430264:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609585536 00000100:00100000:1.0:1787432944.430274:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609585536 00000100:00100000:1.0:1787432944.430366:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787432944.430376:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22719:x1874258609585536:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787432944.430470:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22719:x1874258609585536:12345-0@lo:1000:mdt00_001.0 Request processed in 95us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432944.430477:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787432944.430549:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22719:1874258609585536:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787432944.430703:0:22719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:2.0:1787432944.430749:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22719:1874258609585664:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787432944.430781:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432944.430992:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432944.431033:0:23798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609585664 00000100:00100000:3.0:1787432944.431047:0:23798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609585664 00000100:00100000:0.0:1787432944.431093:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787432944.431106:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22719:x1874258609585664:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787432944.431244:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22719:x1874258609585664:12345-0@lo:1000:mdt00_001.0 Request processed in 142us (461us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1787432944.431251:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787432944.431395:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22719:1874258609585664:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787432944.431427:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dd2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.431437:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dd2 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.431444:0:22719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dd2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.431451:0:22719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ec00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432944.431455:0:22719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dd2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.431463:0:22719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dd2 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.431480:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948411a7a500) 00010000:00010000:2.0:1787432944.431483:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432944.431508:0:22719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dd2 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.431515:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dd2 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.431545:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640d2a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.431553:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640d2a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.431559:0:22719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640d2a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.431565:0:22719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432944.431568:0:22719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640d2a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.431574:0:22719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640d2a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.431584:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:2.0:1787432944.431586:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432944.431593:0:22719:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b335640d31 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d547d expref: 18 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.431604:0:22719:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b335640d31 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d547d expref: 18 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.431614:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b335640d31 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d547d expref: 18 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.431677:0:22719:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b335640d31 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d547d expref: 18 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432944.431689:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22719:1874258609585792:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787432944.431750:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787432944.435680:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432944.435782:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22719:1874258609585792:192.168.204.24@tcp:105: 00010000:00010000:0.0:1787432944.435823:0:22719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640d2a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.435834:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640d2a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.435869:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640dd9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.435902:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640dd9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.435912:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640dd9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.435923:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640dd9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.435930:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640dd9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.435936:0:22719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640dd9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.435942:0:22719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301edae00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432944.435946:0:22719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640dd9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.435953:0:22719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640dd9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.435964:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:0.0:1787432944.435967:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432944.435971:0:22719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640dd9 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.435976:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301edae00/0xca72b3b335640dd9 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.435986:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b335640dcb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.435999:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b335640dcb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.436005:0:22719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b335640dcb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.436009:0:22719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432944.436012:0:22719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b335640dcb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.436018:0:22719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b335640dcb lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.436026:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:0.0:1787432944.436029:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787432944.436032:0:22719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b335640dcb lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432944.436050:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b335640dcb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432944.436246:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:454691f5-94b0-49cf-b719-d8e9565d245e+18:18855:x1874258588510336:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 23576us (23746us total) trans 12884901924 rc 0/0 00000100:00100000:0.0:1787432944.436257:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 70 00000020:00080000:0.0:1787432944.436263:0:22719:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787432944.436407:0:22754:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787432944.436413:0:22754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432944.436428:0:22754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1787432944.436434:0:22754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787432944.436537:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588510720 00000100:00100000:1.0:1787432944.436544:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588510720 00000100:00100000:1.0:1787432944.436592:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:1.0:1787432944.436602:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:454691f5-94b0-49cf-b719-d8e9565d245e+18:18853:x1874258588510720:12345-192.168.204.24@tcp:49:bash.0 00000100:00100000:1.0:1787432944.436697:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:454691f5-94b0-49cf-b719-d8e9565d245e+18:18853:x1874258588510720:12345-192.168.204.24@tcp:49:bash.0 Request processed in 96us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432944.436704:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:0.0:1787432944.439819:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432944.440052:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588510848 00000100:00100000:1.0:1787432944.440062:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588510848 00000100:00100000:1.0:1787432944.440310:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:1.0:1787432944.440323:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483036e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:454691f5-94b0-49cf-b719-d8e9565d245e+7:18853:x1874258588510848:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787432944.440341:0:24228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432944.440364:0:24228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdb67b90/0xca72b3b335640de0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d54b5 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787432944.440389:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a8a0fef, atime: 0x6a8a0fed, ctime: 0x6a8a0fef, blocks: 0x0 00010000:00010000:1.0:1787432944.440414:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=755s v=(0 0) 00010000:00010000:1.0:1787432944.440419:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432944.440429:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb67b90/0xca72b3b335640de0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54b5 expref: 8 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.440467:0:24228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bdb67b90/0xca72b3b335640de0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54b5 expref: 8 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.440481:0:24228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302775600, rc 0) 00000100:00100000:1.0:1787432944.440555:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483036e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:454691f5-94b0-49cf-b719-d8e9565d245e+8:18853:x1874258588510848:12345-192.168.204.24@tcp:101:bash.0 Request processed in 234us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432944.440563:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:2.0:1787432944.443392:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432944.444394:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588510976 00000100:00100000:3.0:1787432944.444405:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588510976 00000100:00100000:3.0:1787432944.444467:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 71 00000100:00100000:3.0:1787432944.444478:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+18:18853:x1874258588510976:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787432944.444511:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432944.444533:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640de7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d54bc expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.444568:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b335640dee lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.444583:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b335640dee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.444594:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b335640dee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.444715:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640de7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54bc expref: 20 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.444734:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b335640dee lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54bc expref: 19 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.444756:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:3.0:1787432944.444759:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787432944.444762:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f1a00, rc 0) 00000100:00100000:3.0:1787432944.445681:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+19:18853:x1874258588510976:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1199us (2292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432944.445691:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 71 00000100:00100000:2.0:1787432944.445823:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432944.447967:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588511232 00000100:00100000:1.0:1787432944.447980:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588511232 00000100:00100000:1.0:1787432944.448058:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00100000:1.0:1787432944.448067:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:454691f5-94b0-49cf-b719-d8e9565d245e+19:18855:x1874258588511232:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787432944.448317:0:22721:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787432944.448347:0:22721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:1.0:1787432944.448382:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640df5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.448397:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640df5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.448409:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640df5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.448418:0:22721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640df5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.448425:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640df5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.448449:0:22721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640df5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432944.448477:0:22721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787432944.448572:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:454691f5-94b0-49cf-b719-d8e9565d245e+21:18855:x1874258588511232:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 505us (2749us total) trans 12884901926 rc 0/0 00000100:00100000:1.0:1787432944.448580:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 13 00000020:00080000:1.0:1787432944.448585:0:22721:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787432944.448982:0:25337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432944.448991:0:25337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640df5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.449000:0:25337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302774c00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432944.449004:0:25337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640df5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.449012:0:25337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640df5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.449622:0:25337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff948411a7a500) 00010000:00010000:3.0:1787432944.449627:0:25337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787432944.449633:0:25337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640df5 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.449641:0:25337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302774c00/0xca72b3b335640df5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.449654:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432944.449656:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432944.449658:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432944.451105:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432944.451400:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588511488 00000100:00100000:3.0:1787432944.451427:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588511488 00000100:00100000:3.0:1787432944.451478:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:3.0:1787432944.451488:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:454691f5-94b0-49cf-b719-d8e9565d245e+21:18853:x1874258588511488:12345-192.168.204.24@tcp:35:bash.0 00000001:00080000:3.0:1787432944.451835:0:22722:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:3.0:1787432944.451938:0:22722:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:3.0:1787432944.452241:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:454691f5-94b0-49cf-b719-d8e9565d245e+24:18853:x1874258588511488:12345-192.168.204.24@tcp:35:bash.0 Request processed in 753us (1140us total) trans 12884901929 rc 0/0 00000100:00100000:3.0:1787432944.452250:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 14 00000020:00080000:3.0:1787432944.452255:0:22722:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787432944.574008:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432944.574130:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588511744 00000100:00100000:2.0:1787432944.574140:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588511744 00000100:00100000:2.0:1787432944.574242:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 72 00000100:00100000:2.0:1787432944.574253:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+24:18865:x1874258588511744:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432944.574281:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432944.574305:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d54c3 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432944.574420:0:22720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787432944.574537:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dfc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54c3 expref: 26 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.574554:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948411a7a100) 00010000:00010000:2.0:1787432944.574557:0:22720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432944.574562:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640dfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d54c3 expref: 26 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432944.574578:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85ec00, rc 0) 00000100:00100000:2.0:1787432944.574677:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:454691f5-94b0-49cf-b719-d8e9565d245e+25:18865:x1874258588511744:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 425us (679us total) trans 12884901930 rc 301/301 00000100:00100000:2.0:1787432944.574685:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 72 00000100:00100000:0.0:1787432944.578376:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432944.578467:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588511872 00000100:00100000:3.0:1787432944.578478:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588511872 00000100:00100000:3.0:1787432944.578554:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 73 00000100:00100000:3.0:1787432944.578566:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+25:18865:x1874258588511872:12345-192.168.204.24@tcp:34:lfs.0 00010000:00010000:3.0:1787432944.578656:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640e0a lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.578675:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640e0a lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.578689:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640e0a lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.578707:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b335640e11 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.578714:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b335640e11 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.578734:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b335640e11 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.578860:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b335640e18 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.578870:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b335640e18 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.578878:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b335640e18 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432944.578929:0:22718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b335640e18 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.578941:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640e0a lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.578948:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640e0a lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.578955:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640e0a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.578961:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432944.578965:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640e0a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.578972:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640e0a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.578983:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff948303542f00) 00010000:00010000:3.0:1787432944.578986:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432944.578992:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640e0a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.579005:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b335640e0a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.579019:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b335640e11 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.579025:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b335640e11 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.579030:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b335640e11 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.579035:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432944.579038:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b335640e11 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.579045:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b335640e11 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.579053:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9483032ad800) 00010000:00010000:3.0:1787432944.579055:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432944.579058:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b335640e11 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.579064:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b335640e11 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.579080:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b335640e18 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.579085:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b335640e18 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.579098:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b335640e18 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.579102:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432944.579105:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b335640e18 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.579111:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b335640e18 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.579118:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff948405994700) 00010000:00010000:3.0:1787432944.579120:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432944.579123:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b335640e18 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432944.579129:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b335640e18 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432944.579255:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:454691f5-94b0-49cf-b719-d8e9565d245e+25:18865:x1874258588511872:12345-192.168.204.24@tcp:34:lfs.0 Request processed in 690us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432944.579264:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 73 00000100:00100000:1.0:1787432944.583788:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432944.583953:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588512128 00000100:00100000:2.0:1787432944.583963:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588512128 00000100:00100000:2.0:1787432944.584061:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:2.0:1787432944.584073:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:454691f5-94b0-49cf-b719-d8e9565d245e+25:18865:x1874258588512128:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:2.0:1787432944.584668:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:454691f5-94b0-49cf-b719-d8e9565d245e+26:18865:x1874258588512128:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 595us (890us total) trans 12884901931 rc 0/0 00000100:00100000:2.0:1787432944.584676:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:1.0:1787432944.670915:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432944.670973:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432944.671011:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432944.671100:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432944.671142:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588512512 00000100:00100000:3.0:1787432944.672285:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588513024 00000100:00100000:3.0:1787432944.672296:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588513024 00000100:00100000:3.0:1787432944.672384:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:3.0:1787432944.672395:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1550083-39d1-481c-8177-f7494d742169+5:2401:x1874258588513024:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432944.672505:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1550083-39d1-481c-8177-f7494d742169+5:2401:x1874258588513024:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 112us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432944.672513:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:3.0:1787432944.672958:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432944.673023:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588512512 00000100:00100000:1.0:1787432944.673060:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:1.0:1787432944.673069:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:454691f5-94b0-49cf-b719-d8e9565d245e+5:2401:x1874258588512512:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432944.673098:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:454691f5-94b0-49cf-b719-d8e9565d245e+5:2401:x1874258588512512:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (2125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432944.673105:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:0.0:1787432944.675751:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588512256 00000100:00100000:0.0:1787432944.675769:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588512256 00000100:00100000:0.0:1787432944.675938:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 164 00000100:00100000:0.0:1787432944.675965:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434d94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:2401:x1874258588512256:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432944.676047:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434d94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e17f28a9-e09d-421e-8a64-93305d5e5e85+13:2401:x1874258588512256:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 84us (5142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432944.676054:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 164 00000100:00080000:0.0:1787432944.676095:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432944.676102:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432944.680828:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432944.682772:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588512768 00000100:00100000:2.0:1787432944.682792:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588512768 00000100:00100000:2.0:1787432944.682953:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588512384 00000100:00100000:2.0:1787432944.682957:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588512384 00000100:00100000:2.0:1787432944.683000:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00100000:2.0:1787432944.683012:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1550083-39d1-481c-8177-f7494d742169+5:2401:x1874258588512768:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432944.683112:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1550083-39d1-481c-8177-f7494d742169+5:2401:x1874258588512768:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 102us (12100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432944.683120:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00080000:1.0:1787432944.685273:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787432944.686415:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:2.0:1787432944.686435:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+5:2401:x1874258588512384:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432944.686541:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:454691f5-94b0-49cf-b719-d8e9565d245e+5:2401:x1874258588512384:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 113us (13582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432944.686550:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:3.0:1787432944.687607:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432944.688072:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588512896 00000100:00100000:0.0:1787432944.688082:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588512896 00000100:00100000:0.0:1787432944.688159:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:0.0:1787432944.688190:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1550083-39d1-481c-8177-f7494d742169+5:2401:x1874258588512896:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432944.688250:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1550083-39d1-481c-8177-f7494d742169+5:2401:x1874258588512896:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 62us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432944.688257:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00080000:1.0:1787432944.688729:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432944.688869:0:23799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588512640 00000100:00100000:2.0:1787432944.688886:0:23799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588512640 00000100:00100000:2.0:1787432944.688959:0:23799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 56 00000100:00100000:2.0:1787432944.688968:0:23799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1550083-39d1-481c-8177-f7494d742169+6:2401:x1874258588512640:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432944.689014:0:23799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1550083-39d1-481c-8177-f7494d742169+6:2401:x1874258588512640:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 47us (8197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432944.689020:0:23799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 56 00000100:00080000:1.0:1787432944.689252:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787432944.779448:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432945.614801:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432945.614828:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609585920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432945.614899:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432945.615407:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609585920 00000100:00100000:3.0:1787432945.615416:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609585920 00000100:00100000:3.0:1787432945.615491:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787432945.615502:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609585920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787432945.615531:0:24230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787432945.615593:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609585920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432945.615601:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787432945.615862:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609585920:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787432945.615924:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787432945.811849:0:22707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432946.635430:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432946.635464:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609586048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432946.635566:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432946.635659:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609586048 00000100:00100000:1.0:1787432946.635667:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609586048 00000100:00100000:1.0:1787432946.635723:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787432946.635733:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609586048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787432946.635789:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1787432946.635842:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609586048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432946.635848:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787432946.635892:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609586048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432946.636523:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432946.636559:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94840356b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609586176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432946.636607:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432946.636892:0:23798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609586176 00000100:00100000:1.0:1787432946.636898:0:23798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609586176 00000100:00100000:1.0:1787432946.636935:0:23798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787432946.636942:0:23798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609586176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787432946.636963:0:23798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787432946.637010:0:23798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609586176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432946.637016:0:23798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787432946.637080:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94840356b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609586176:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1787432946.747847:0:25801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1787432946.831156:0:25337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787432947.725899:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787432947.851923:0:22708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432948.245674:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432948.245736:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432948.245779:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588513152 00000100:00100000:1.0:1787432948.245791:0:24231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588513152 00002000:00100000:1.0:1787432948.245929:0:24231:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff948409d26300 x1874258588513152/t0(0) o4->454691f5-94b0-49cf-b719-d8e9565d245e@192.168.204.24@tcp:659/0 lens 504/0 e 0 to 0 dl 1787432959 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787432948.245940:0:24231:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948409d26300 with x1874258588513152 ext(0->8) 00002000:00010000:1.0:1787432948.245946:0:24231:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948409d26300 00000100:00100000:1.0:1787432948.245978:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:1.0:1787432948.245988:0:24231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:454691f5-94b0-49cf-b719-d8e9565d245e+8:2402:x1874258588513152:12345-192.168.204.24@tcp:4:bash.0 00000100:00100000:2.0:1787432948.246560:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588513280 00000100:00100000:2.0:1787432948.246567:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588513280 00000100:00100000:2.0:1787432948.246610:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 34 00000100:00100000:2.0:1787432948.246619:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:454691f5-94b0-49cf-b719-d8e9565d245e+11:2402:x1874258588513280:12345-192.168.204.24@tcp:16:kworker.0 00000100:00100000:2.0:1787432948.246939:0:24231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:454691f5-94b0-49cf-b719-d8e9565d245e+11:2402:x1874258588513152:12345-192.168.204.24@tcp:4:bash.0 Request processed in 951us (1275us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1787432948.246954:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 0 00002000:00100000:2.0:1787432948.246963:0:24231:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff948409d26300 x1874258588513152/t12884901895(0) o4->454691f5-94b0-49cf-b719-d8e9565d245e@192.168.204.24@tcp:659/0 lens 504/448 e 0 to 0 dl 1787432959 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787432948.246973:0:24231:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948409d26300 with x1874258588513152 ext(0->8) 00002000:00010000:2.0:1787432948.246978:0:24231:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948409d26300 00000100:00080000:0.0:1787432948.247325:0:22715:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787432948.248930:0:25040:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:3.0:1787432948.248945:0:25040:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00000100:00100000:2.0:1787432948.250515:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:454691f5-94b0-49cf-b719-d8e9565d245e+6:2402:x1874258588513280:12345-192.168.204.24@tcp:16:kworker.0 Request processed in 3886us (4778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432948.250530:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 34 Debug log: 14525 lines, 14525 kept, 0 dropped, 0 bad.