00000100:00100000:1.0F:1785945473.704950:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872699165132416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785945473.705034:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1785945473.705259:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165132416 00000100:00100000:0.0:1785945473.705272:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165132416 00000100:00100000:0.0:1785945473.705319:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1785945473.705328:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b6a5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1872699165132416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1785945473.705358:0:7466:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446195200 avail 1299955712 00000100:00100000:0.0:1785945473.705411:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b6a5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1872699165132416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945473.705418:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1785945473.705519:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872699165132416:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1785945473.715969:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b41537400/0xf1067778b2c2bd07 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xf1067778b2c2bd0e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785945473.715987:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b41537400/0xf1067778b2c2bd07 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xf1067778b2c2bd0e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945473.716026:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b41537400/0xf1067778b2c2bd07 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2bd0e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945473.716033:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785945473.716053:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b41537400/0xf1067778b2c2bd07 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2bd0e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785945473.716071:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000020:00080000:0.0:1785945473.716079:0:6498:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff890a4369b000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1785945473.716093:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff890b7bbc9800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff890b47118900 00000020:00080000:0.0:1785945473.716096:0:6498:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].2 00000020:00080000:0.0:1785945473.716099:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff890b7bbc9600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890a43559000 00000020:00080000:0.0:1785945473.716101:0:6498:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].2 00000020:00080000:0.0:1785945473.716112:0:6498:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff890b49211240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1785945473.716115:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff890b75038c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff890b49211540 00000020:00080000:0.0:1785945473.716131:0:6498:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].1 00000020:00080000:0.0:1785945473.716133:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff890b75038800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890a43121800 00000020:00080000:0.0:1785945473.716135:0:6498:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].1 00000100:00100000:0.0:1785945473.716158:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165132544:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1785945473.716225:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945473.716292:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165132544 00000100:00100000:0.0:1785945473.716299:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165132544 00000100:00100000:0.0:1785945473.716340:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785945473.716347:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1872699165132544:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1785945473.716358:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785945473.716374:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd0e lrc: 0/0,0 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xf1067778b2c2bd07 expref: 6 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945473.716388:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff890a42091f00) 00010000:00010000:0.0:1785945473.716393:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785945473.716423:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872699165132544:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 76us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945473.716431:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785945473.716482:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165132544:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1785945473.716639:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890b40030e00/0xf1067778b2c2bbf6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc37909cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716649:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b40030e00/0xf1067778b2c2bbf6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc37909cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716656:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b40030e00/0xf1067778b2c2bbf6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc37909cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716662:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b40030e00 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945473.716697:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b40030e00/0xf1067778b2c2bbf6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc37909cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716705:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b40030e00/0xf1067778b2c2bbf6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc37909cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716715:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc37909cf (ffff890a43268500) 00010000:00010000:1.0:1785945473.716718:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945473.716721:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b40030e00/0xf1067778b2c2bbf6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc37909cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716727:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b40030e00/0xf1067778b2c2bbf6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc37909cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716742:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031600/0xf1067778b2c2bbfd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716747:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031600/0xf1067778b2c2bbfd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716763:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031600/0xf1067778b2c2bbfd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716769:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b40031600 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945473.716771:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031600/0xf1067778b2c2bbfd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716777:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031600/0xf1067778b2c2bbfd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716785:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890a42d7c100) 00010000:00010000:1.0:1785945473.716787:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945473.716790:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031600/0xf1067778b2c2bbfd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716795:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031600/0xf1067778b2c2bbfd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716804:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bc04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716810:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bc04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716815:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bc04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716820:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b40031000 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945473.716823:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bc04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716837:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bc04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716845:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff890a42d7ca00) 00010000:00010000:1.0:1785945473.716847:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945473.716850:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bc04 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945473.716857:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bc04 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0F:1785945473.717186:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bae8600/0xf1067778b2c2bce4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945473.717201:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bae8600/0xf1067778b2c2bce4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945473.717208:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bae8600/0xf1067778b2c2bce4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945473.717214:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7bae8600 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:2.0:1785945473.717217:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bae8600/0xf1067778b2c2bce4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945473.717224:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bae8600/0xf1067778b2c2bce4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945473.717232:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0xd04803f8 (ffff890b4709f200) 00010000:00010000:2.0:1785945473.717235:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785945473.717238:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bae8600/0xf1067778b2c2bce4 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945473.717245:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bae8600/0xf1067778b2c2bce4 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1785945473.717265:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 0 00000020:00080000:2.0:1785945473.717407:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:0.0:1785945474.095054:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785945474.224447:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785945474.224471:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a42f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872699165132672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785945474.224539:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945474.224784:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165132672 00000100:00100000:1.0:1785945474.224790:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165132672 00000100:00100000:1.0:1785945474.224924:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1785945474.224935:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872699165132672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1785945474.224959:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785945474.225010:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872699165132672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945474.225017:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1785945474.225036:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785945474.225066:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a42f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872699165132672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785945474.225114:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7502b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872699165132800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785945474.225142:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945474.225198:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165132800 00000100:00100000:1.0:1785945474.225202:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165132800 00000100:00100000:1.0:1785945474.225232:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1785945474.225238:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a434ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872699165132800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785945474.225248:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785945474.225291:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a434ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872699165132800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945474.225303:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1785945474.225330:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7502b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872699165132800:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1785945474.225413:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785945474.731016:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785945474.731044:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a41a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872699165132928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785945474.731126:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945474.731222:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165132928 00000100:00100000:2.0:1785945474.731230:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165132928 00000100:00100000:2.0:1785945474.731295:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1785945474.731303:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a43567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1872699165132928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1785945474.731359:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446408192 avail 1300168704 00000100:00100000:2.0:1785945474.731422:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a43567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1872699165132928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945474.731442:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1785945474.731491:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a41a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872699165132928:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1785945475.123945:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785945475.858069:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:0.0:1785945475.858140:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:0.0:1785945475.858164:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134604928 00000100:00100000:0.0:1785945475.858182:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134604928 00000100:00100000:0.0:1785945475.858261:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 320 00000100:00100000:0.0:1785945475.858273:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a434a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+7:2398:x1872699134604928:12345-192.168.201.47@tcp:400:kworker.0 00000100:00100000:0.0:1785945475.858342:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a434a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+7:2398:x1872699134604928:12345-192.168.201.47@tcp:400:kworker.0 Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945475.858350:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 320 00000100:00080000:0.0:1785945475.858372:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1785945475.858401:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945475.859002:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134604672 00000100:00100000:1.0:1785945475.859008:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134604672 00000100:00100000:1.0:1785945475.859193:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 356 00000100:00100000:1.0:1785945475.859201:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b464bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5045a659-c567-4cac-bdde-f6c848dd97e5+10:2398:x1872699134604672:12345-192.168.201.47@tcp:400:kworker.0 00000100:00100000:1.0:1785945475.859233:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b464bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5045a659-c567-4cac-bdde-f6c848dd97e5+10:2398:x1872699134604672:12345-192.168.201.47@tcp:400:kworker.0 Request processed in 34us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945475.859240:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 356 00000100:00100000:0.0:1785945475.861201:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:0.0:1785945475.861272:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:0.0:1785945475.861303:0:9395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134605184 00000100:00100000:0.0:1785945475.861309:0:9395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134605184 00000100:00100000:0.0:1785945475.861345:0:9395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134605056 00000100:00100000:0.0:1785945475.861347:0:9395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134605056 00000100:00100000:0.0:1785945475.861364:0:9395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 118 00000100:00100000:0.0:1785945475.861371:0:9395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a42cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+6:2398:x1872699134605184:12345-192.168.201.47@tcp:400:kworker.0 00000100:00100000:0.0:1785945475.861440:0:9395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a42cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+6:2398:x1872699134605184:12345-192.168.201.47@tcp:400:kworker.0 Request processed in 69us (3038us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945475.861446:0:9395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 118 00000100:00100000:0.0:1785945475.861458:0:9395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 119 00000100:00100000:0.0:1785945475.861464:0:9395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a42ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:2398:x1872699134605056:12345-192.168.201.47@tcp:400:kworker.0 00000100:00100000:0.0:1785945475.861497:0:9395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a42ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:2398:x1872699134605056:12345-192.168.201.47@tcp:400:kworker.0 Request processed in 34us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945475.861502:0:9395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 119 00000100:00080000:0.0:1785945475.861527:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785945475.861531:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785945475.861627:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134604800 00000100:00100000:1.0:1785945475.861631:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134604800 00000100:00100000:1.0:1785945475.861661:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 321 00000100:00100000:1.0:1785945475.861693:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a42ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:2398:x1872699134604800:12345-192.168.201.47@tcp:400:kworker.0 00000100:00100000:1.0:1785945475.861734:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a42ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:2398:x1872699134604800:12345-192.168.201.47@tcp:400:kworker.0 Request processed in 68us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945475.861739:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 321 00000100:00080000:0.0:1785945475.864294:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0F:1785945476.139173:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785945477.163498:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785945477.802660:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7502b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d82a3e60-742f-488f-987a-c5d63577fef1:3644:1872699165133056:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.802757:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945477.802818:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a436adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165133568:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.802864:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945477.802884:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a436ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165134080:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.802917:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945477.802935:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a436f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165134592:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.802970:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945477.802994:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1785945477.803000:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7502a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872699165133184:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803020:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945477.803036:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a436ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872699165133696:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803055:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945477.803086:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a436ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872699165134208:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803107:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945477.803136:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b75028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872699165133312:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803158:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945477.803171:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a436aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872699165133824:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945477.803218:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a436f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872699165134336:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803237:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945477.803252:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1785945477.803257:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b75028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872699165133440:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803273:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945477.803282:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a436ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872699165133952:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803298:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945477.803313:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a436f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872699165134464:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945477.803353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165133056 00000100:00100000:1.0:1785945477.803360:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165133056 00000100:00100000:1.0:1785945477.803419:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1785945477.803429:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b464bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d82a3e60-742f-488f-987a-c5d63577fef1+24:3644:x1872699165133056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803489:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b464bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d82a3e60-742f-488f-987a-c5d63577fef1+24:3644:x1872699165133056:12345-0@lo:400:kworker.0 Request processed in 59us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945477.803496:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1785945477.803527:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165133568 00000100:00100000:1.0:1785945477.803531:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165133568 00000100:00100000:1.0:1785945477.803551:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165133312 00000100:00100000:1.0:1785945477.803553:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165133312 00000100:00100000:1.0:1785945477.803565:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1785945477.803571:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1872699165133568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803606:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1872699165133568:12345-0@lo:400:kworker.0 Request processed in 35us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945477.803612:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1785945477.803623:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1785945477.803629:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1872699165133312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803659:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1872699165133312:12345-0@lo:400:kworker.0 Request processed in 31us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945477.803664:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1785945477.803709:0:9395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165134080 00000100:00100000:1.0:1785945477.803712:0:9395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165134080 00000100:00100000:1.0:1785945477.803739:0:9395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165134592 00000100:00100000:1.0:1785945477.803741:0:9395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165134592 00000100:00100000:1.0:1785945477.803750:0:9395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165133952 00000100:00100000:1.0:1785945477.803752:0:9395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165133952 00000100:00100000:1.0:1785945477.803761:0:9395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165134464 00000100:00100000:1.0:1785945477.803763:0:9395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165134464 00000100:00100000:1.0:1785945477.803774:0:9395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1785945477.803780:0:9395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1872699165134080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803811:0:9395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1872699165134080:12345-0@lo:400:kworker.0 Request processed in 32us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945477.803822:0:9395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1785945477.803834:0:9395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1785945477.803840:0:9395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1872699165134592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803870:0:9395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1872699165134592:12345-0@lo:400:kworker.0 Request processed in 30us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945477.803875:0:9395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1785945477.803884:0:9395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1785945477.803889:0:9395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b776fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1872699165133952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803916:0:9395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b776fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1872699165133952:12345-0@lo:400:kworker.0 Request processed in 27us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945477.803921:0:9395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1785945477.803931:0:9395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1785945477.803937:0:9395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b776fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1872699165134464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.803965:0:9395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b776fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1872699165134464:12345-0@lo:400:kworker.0 Request processed in 28us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945477.803970:0:9395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1785945477.803989:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165133184 00000100:00100000:1.0:1785945477.803992:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165133184 00000100:00100000:1.0:1785945477.804010:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165133696 00000100:00100000:1.0:1785945477.804013:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165133696 00000100:00100000:1.0:1785945477.804025:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165134208 00000100:00100000:1.0:1785945477.804027:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165134208 00000100:00100000:1.0:1785945477.804037:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165133824 00000100:00100000:1.0:1785945477.804039:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165133824 00000100:00100000:1.0:1785945477.804049:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165134336 00000100:00100000:1.0:1785945477.804051:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165134336 00000100:00100000:1.0:1785945477.804061:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165133440 00000100:00100000:1.0:1785945477.804070:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165133440 00000100:00100000:1.0:1785945477.804087:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1785945477.804093:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872699165133184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804127:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872699165133184:12345-0@lo:400:kworker.0 Request processed in 33us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945477.804132:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1785945477.804143:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1785945477.804150:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872699165133696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804180:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872699165133696:12345-0@lo:400:kworker.0 Request processed in 31us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945477.804186:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1785945477.804197:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1785945477.804203:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872699165134208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804233:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872699165134208:12345-0@lo:400:kworker.0 Request processed in 30us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945477.804238:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1785945477.804249:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1785945477.804255:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b776fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872699165133824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804284:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b776fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872699165133824:12345-0@lo:400:kworker.0 Request processed in 29us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945477.804289:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1785945477.804300:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1785945477.804305:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b776fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872699165134336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804329:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b776fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872699165134336:12345-0@lo:400:kworker.0 Request processed in 24us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945477.804343:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1785945477.804354:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1785945477.804360:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b776fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872699165133440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804402:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b776fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872699165133440:12345-0@lo:400:kworker.0 Request processed in 42us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945477.804408:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00080000:1.0:1785945477.804445:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1785945477.804449:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785945477.804451:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785945477.804453:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785945477.804482:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b75028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872699165133440:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804492:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a436ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872699165133952:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804500:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a436f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872699165134464:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804508:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b75028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872699165133312:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804516:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a436aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872699165133824:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804525:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a436f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872699165134336:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804560:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7502a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872699165133184:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804569:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a436ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872699165133696:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804577:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a436ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872699165134208:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804585:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7502b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d82a3e60-742f-488f-987a-c5d63577fef1:3644:1872699165133056:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804592:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a436adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165133568:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804612:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a436ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165134080:0@lo:400:kworker.0 00000100:00100000:1.0:1785945477.804620:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a436f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165134592:0@lo:400:kworker.0 00000100:00100000:2.0:1785945477.804816:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a43566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872699165134720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785945477.804848:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945477.804902:0:9960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165134720 00000100:00100000:2.0:1785945477.804906:0:9960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165134720 00000100:00100000:2.0:1785945477.804934:0:9960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1785945477.804940:0:9960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a41a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872699165134720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785945477.804962:0:9960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785945477.804996:0:9960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a41a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872699165134720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945477.805002:0:9960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1785945477.805034:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a43566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872699165134720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785945477.811434:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785945477.811478:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a42f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872699165134848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785945477.811547:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785945477.811594:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165134848 00000100:00100000:3.0:1785945477.811601:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165134848 00000100:00100000:3.0:1785945477.811654:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1785945477.811662:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a4368e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872699165134848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785945477.811701:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1785945477.811817:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a4368e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872699165134848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945477.811824:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1785945477.811869:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a42f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872699165134848:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1785945477.815721:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:3.0:1785945478.186692:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785945478.539049:0:14185:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 24Kb: cross-MDT RENAME_NOREPLACE fails if the target name exists ========================================================== 11:57:55 (1785945475) 00000100:00100000:3.0:1785945478.707936:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945478.708104:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134605312 00000100:00100000:3.0:1785945478.708113:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134605312 00000100:00100000:3.0:1785945478.708176:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 51 00000100:00100000:3.0:1785945478.708186:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a4368f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:12139:x1872699134605312:12345-192.168.201.47@tcp:41:stat.0 00000004:00000024:3.0:1785945478.708233:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847051264 avail 7383977984 00000100:00100000:3.0:1785945478.708294:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a4368f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:12139:x1872699134605312:12345-192.168.201.47@tcp:41:stat.0 Request processed in 109us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945478.708302:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 51 00000100:00080000:0.0:1785945478.708561:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785945478.788475:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945478.788520:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134605440 00000100:00100000:1.0:1785945478.788529:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134605440 00000100:00100000:1.0:1785945478.788574:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 52 00000100:00100000:1.0:1785945478.788583:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b776fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:12143:x1872699134605440:12345-192.168.201.47@tcp:101:lfs.0 00010000:00010000:1.0:1785945478.788603:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945478.788665:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be49384816 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788735:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bd62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788749:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bd62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788759:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bd62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788784:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788791:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788797:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788845:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bd62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788852:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bd62 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788858:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bd62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788864:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7bb7f200 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945478.788867:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bd62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788874:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bd62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788885:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890b760c5900) 00010000:00010000:1.0:1785945478.788888:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945478.788891:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bd62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788897:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bd62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788908:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788913:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788919:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788928:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7bb7fc00 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945478.788932:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788937:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788945:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf49c0507 (ffff890a42091700) 00010000:00010000:1.0:1785945478.788947:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945478.788949:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788955:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788982:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384816 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.788990:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890b760c5900) 00010000:00010000:1.0:1785945478.788993:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945478.788996:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384816 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.789005:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7bb7e800, rc 0) 00000100:00100000:1.0:1785945478.789057:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b776fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:12143:x1872699134605440:12345-192.168.201.47@tcp:101:lfs.0 Request processed in 475us (588us total) trans 0 rc 301/301 00000100:00100000:1.0:1785945478.789064:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 52 00000100:00100000:1.0:1785945478.803153:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:0.0:1785945478.804791:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134605696 00000100:00100000:0.0:1785945478.804802:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134605696 00000100:00100000:0.0:1785945478.805222:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 53 00000100:00100000:0.0:1785945478.805233:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b776fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:12143:x1872699134605696:12345-192.168.201.47@tcp:36:lfs.0 00010000:00010000:0.0:1785945478.805281:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785945478.805305:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bc20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be493847c2 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.805320:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890b760c5900) 00010000:00010000:0.0:1785945478.805325:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785945478.805393:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd600/0xf1067778b2c2bd70 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.805407:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd600/0xf1067778b2c2bd70 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.805415:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd600/0xf1067778b2c2bd70 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.805428:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fde00/0xf1067778b2c2bd77 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.805435:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fde00/0xf1067778b2c2bd77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.805453:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fde00/0xf1067778b2c2bd77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785945478.810968:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].3, 2152 off37632 00000040:00080000:0.0:1785945478.811069:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].3, 2352 off38112 00000004:00080000:0.0:1785945478.811078:0:6520:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff890b483a0b40 with version 6 00000004:00080000:3.0:1785945478.815844:0:7680:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff890b4dc96d80 version 6 rpc_version 6 00000020:00100000:3.0:1785945478.815888:0:7680:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785945478.815900:0:7680:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff890a4368ea00 x1872699165135104/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785945478.815924:0:7680:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a4368ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7680:1872699165135104:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785945478.815991:0:7680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785945478.816043:0:7680:0:(client.c:2702:ptlrpc_set_wait()) set ffff890a4369b600 going to sleep for 11 seconds 00000100:00100000:1.0:1785945478.816108:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165135104 00000100:00100000:1.0:1785945478.816116:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165135104 00000100:00100000:1.0:1785945478.816169:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1785945478.816178:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a4368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7680:x1872699165135104:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785945478.816757:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a4368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7680:x1872699165135104:12345-0@lo:1000:osp_up1-0.0 Request processed in 579us (764us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1785945478.816765:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1785945478.816896:0:7680:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a4368ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7680:1872699165135104:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1785945478.817081:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.817096:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.817107:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.817124:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd85 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.817130:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd85 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.817136:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd85 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.817197:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7f200/0xf1067778b2c2bd8c lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.817205:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7f200/0xf1067778b2c2bd8c lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.817214:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7f200/0xf1067778b2c2bd8c lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785945478.817258:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b776ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165135232:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1785945478.817285:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945478.817310:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b78fe3a80 going to sleep for 11 seconds 00000001:00080000:3.0:1785945478.817496:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967313 is committed 00000020:00080000:3.0:1785945478.817506:0:6498:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:0.0:1785945478.817548:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 2 00000004:00080000:0.0:1785945478.817594:0:6550:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff890b4397e840 with version 7 00000020:00080000:0.0:1785945478.817606:0:6550:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 1 cancel update log [0x240000401:0x3:0x0].1: rc = 0 00000020:00080000:0.0:1785945478.817645:0:6550:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 1 cancel update log [0x200000400:0x3:0x0].1: rc = 0 00000004:00080000:0.0:1785945478.817789:0:6550:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff890b44e146c0 with version 8 00000020:00080000:0.0:1785945478.817793:0:6550:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 2 cancel update log [0x240000401:0x3:0x0].2: rc = 0 00000020:00080000:0.0:1785945478.817812:0:6550:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 2 cancel update log [0x200000400:0x3:0x0].2: rc = 0 00000020:00080000:0.0:1785945478.817820:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 2 00000004:00080000:3.0:1785945478.817892:0:7680:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff890b4dc96d80 version 7 rpc_version 7 00000020:00100000:3.0:1785945478.817906:0:7680:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785945478.817912:0:7680:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff890a4368ca80 x1872699165135488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785945478.817926:0:7680:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a4368ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7680:1872699165135488:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785945478.817963:0:7680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785945478.817993:0:7680:0:(client.c:2702:ptlrpc_set_wait()) set ffff890a4369b600 going to sleep for 11 seconds 00000100:00100000:1.0:1785945478.818029:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165135232 00000100:00100000:1.0:1785945478.818034:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165135232 00000100:00100000:1.0:1785945478.818065:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165135488 00000100:00100000:1.0:1785945478.818068:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165135488 00000100:00100000:1.0:1785945478.818082:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1785945478.818088:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6520:x1872699165135232:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1785945478.818102:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945478.818147:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f400/0xf1067778b2c2bd93 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf1067778b2c2bd8c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.818167:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f400/0xf1067778b2c2bd93 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xf1067778b2c2bd8c expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.818179:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f400/0xf1067778b2c2bd93 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2bd8c expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.818187:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff890b760c5a00) 00010000:00010000:1.0:1785945478.818189:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945478.818193:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7bb7f400, rc 0) 00000100:00100000:1.0:1785945478.818233:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6520:x1872699165135232:12345-0@lo:101:mdt00_002.0 Request processed in 145us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945478.818239:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1785945478.818251:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1785945478.818257:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a4368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7680:x1872699165135488:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785945478.818334:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a4368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:7680:x1872699165135488:12345-0@lo:1000:osp_up1-0.0 Request processed in 76us (370us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1785945478.818340:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1785945478.818415:0:7680:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a4368ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7680:1872699165135488:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1785945478.818422:0:7680:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff890b4dc96d80 version 8 rpc_version 8 00000020:00100000:3.0:1785945478.818432:0:7680:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785945478.818437:0:7680:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff890a4368d880 x1872699165135744/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785945478.818449:0:7680:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a4368d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7680:1872699165135744:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785945478.818470:0:7680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785945478.818492:0:7680:0:(client.c:2702:ptlrpc_set_wait()) set ffff890a4369b600 going to sleep for 11 seconds 00000100:00100000:1.0:1785945478.818533:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165135744 00000100:00100000:1.0:1785945478.818537:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165135744 00000100:00100000:1.0:1785945478.818563:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1785945478.818568:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a4368d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:7680:x1872699165135744:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785945478.818630:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a4368d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:7680:x1872699165135744:12345-0@lo:1000:osp_up1-0.0 Request processed in 61us (158us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1785945478.818636:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1785945478.818815:0:7680:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a4368d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7680:1872699165135744:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785945478.818888:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b776ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165135232:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1785945478.818901:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7f200/0xf1067778b2c2bd8c lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2bd93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.818911:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7f200/0xf1067778b2c2bd8c lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2bd93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785945478.818930:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016d169cb reply state 00000000ba523d3b transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd85 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.818942:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.818958:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff890b760c5400) 00010000:00010000:0.0:1785945478.818960:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785945478.818963:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785945478.818968:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7f200/0xf1067778b2c2bd8c lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2bd93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.818976:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7f200/0xf1067778b2c2bd8c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2bd93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785945478.818985:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000004:00010000:0.0:1785945478.818990:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016d169cb reply state 00000000ba523d3b transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.818998:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.819004:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890b760c5e00) 00010000:00010000:0.0:1785945478.819006:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785945478.819008:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1785945478.819013:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1785945478.819019:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd600/0xf1067778b2c2bd70 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.819025:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd600/0xf1067778b2c2bd70 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.819031:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd600/0xf1067778b2c2bd70 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.819037:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890a440fd600 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:0.0:1785945478.819041:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd600/0xf1067778b2c2bd70 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.819055:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd600/0xf1067778b2c2bd70 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.819066:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890b760c5900) 00010000:00010000:0.0:1785945478.819068:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785945478.819071:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd600/0xf1067778b2c2bd70 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.819078:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd600/0xf1067778b2c2bd70 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785945478.819090:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016d169cb reply state 00000000ba523d3b transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fde00/0xf1067778b2c2bd77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.819099:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fde00/0xf1067778b2c2bd77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.819104:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf49c0507 (ffff890b470a0100) 00010000:00010000:0.0:1785945478.819107:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785945478.819109:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00010000:00080000:0.0:1785945478.819170:0:6520:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1785945478.819187:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b776fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:12143:x1872699134605696:12345-192.168.201.47@tcp:36:lfs.0 Request processed in 13955us (16039us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1785945478.819195:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 53 00010000:00010000:2.0:1785945478.819373:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fde00/0xf1067778b2c2bd77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819381:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fde00/0xf1067778b2c2bd77 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819386:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fde00/0xf1067778b2c2bd77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819397:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890a440fde00 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:2.0:1785945478.819400:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fde00/0xf1067778b2c2bd77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819406:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fde00/0xf1067778b2c2bd77 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819414:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf49c0507 (ffff890b470a0100) 00010000:00010000:2.0:1785945478.819416:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785945478.819419:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fde00/0xf1067778b2c2bd77 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819425:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fde00/0xf1067778b2c2bd77 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819437:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819442:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819447:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819451:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7bb7e800 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:2.0:1785945478.819454:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819459:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819474:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890b760c5e00) 00010000:00010000:2.0:1785945478.819476:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785945478.819478:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd7e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819484:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bd7e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819494:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819500:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819505:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819509:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7bb7fc00 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:2.0:1785945478.819512:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819516:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819522:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff890b760c5400) 00010000:00010000:2.0:1785945478.819524:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785945478.819526:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd85 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.819531:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bd85 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785945478.826082:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785945478.826104:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a42cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872699165135872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1785945478.826165:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945478.826217:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165135872 00000100:00100000:0.0:1785945478.826224:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165135872 00000100:00100000:0.0:1785945478.826265:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1785945478.826284:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a42cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1872699165135872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1785945478.826315:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446178816 avail 1299939328 00000100:00100000:0.0:1785945478.826370:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a42cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1872699165135872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945478.826377:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1785945478.826415:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a42cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872699165135872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785945478.842594:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945478.842704:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134605824 00000100:00100000:3.0:1785945478.842714:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134605824 00000100:00100000:3.0:1785945478.842760:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 54 00000100:00100000:3.0:1785945478.842769:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+7:12144:x1872699134605824:12345-192.168.201.47@tcp:101:lfs.0 00010000:00010000:3.0:1785945478.842808:0:9394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785945478.842827:0:9394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baebe00/0xf1067778b2c2bd9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be4938481d expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.842886:0:9394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baea400/0xf1067778b2c2bda1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.842899:0:9394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baea400/0xf1067778b2c2bda1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.842910:0:9394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baea400/0xf1067778b2c2bda1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785945478.842950:0:9394:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1785945478.842954:0:9394:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1785945478.842975:0:9394:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baea400/0xf1067778b2c2bda1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.843000:0:9394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baebe00/0xf1067778b2c2bd9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938481d expref: 9 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.843016:0:9394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baea400/0xf1067778b2c2bda1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938481d expref: 8 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.843025:0:9394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890b760c5900) 00010000:00010000:3.0:1785945478.843028:0:9394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785945478.843032:0:9394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7baea400, rc 0) 00000100:00100000:3.0:1785945478.843092:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:12144:x1872699134605824:12345-192.168.201.47@tcp:101:lfs.0 Request processed in 323us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945478.843099:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 54 00000100:00100000:0.0:1785945478.854839:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:2.0:1785945478.854962:0:11094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134605952 00000100:00100000:2.0:1785945478.854971:0:11094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134605952 00000100:00100000:2.0:1785945478.855032:0:11094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 55 00000100:00100000:2.0:1785945478.855041:0:11094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a42cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:12144:x1872699134605952:12345-192.168.201.47@tcp:101:lfs.0 00010000:00010000:2.0:1785945478.855062:0:11094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785945478.855082:0:11094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031600/0xf1067778b2c2bda8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be49384824 expref: -99 pid: 11094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855144:0:11094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bdaf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855158:0:11094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bdaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855169:0:11094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bdaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855182:0:11094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031a00/0xf1067778b2c2bdb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855189:0:11094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031a00/0xf1067778b2c2bdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855195:0:11094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031a00/0xf1067778b2c2bdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855270:0:11094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b40030000/0xf1067778b2c2bdbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855277:0:11094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b40030000/0xf1067778b2c2bdbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855297:0:11094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b40030000/0xf1067778b2c2bdbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785945478.855380:0:11094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1785945478.855385:0:11094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1785945478.855403:0:11094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890b40030000/0xf1067778b2c2bdbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855414:0:11094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bdaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855419:0:11094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bdaf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855425:0:11094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bdaf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855431:0:11094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b40031000 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:2.0:1785945478.855434:0:11094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bdaf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855441:0:11094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bdaf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855452:0:11094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890b760c5900) 00010000:00010000:2.0:1785945478.855455:0:11094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785945478.855458:0:11094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bdaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855464:0:11094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031000/0xf1067778b2c2bdaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855487:0:11094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031a00/0xf1067778b2c2bdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855492:0:11094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031a00/0xf1067778b2c2bdb6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855498:0:11094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031a00/0xf1067778b2c2bdb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855502:0:11094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b40031a00 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:2.0:1785945478.855504:0:11094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031a00/0xf1067778b2c2bdb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855510:0:11094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031a00/0xf1067778b2c2bdb6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855517:0:11094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf49c0507 (ffff890a42d7c300) 00010000:00010000:2.0:1785945478.855519:0:11094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785945478.855521:0:11094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031a00/0xf1067778b2c2bdb6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855527:0:11094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031a00/0xf1067778b2c2bdb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855552:0:11094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b40031600/0xf1067778b2c2bda8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384824 expref: 10 pid: 11094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855564:0:11094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b40030000/0xf1067778b2c2bdbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384824 expref: 9 pid: 11094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.855581:0:11094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890a42d7cb00) 00010000:00010000:2.0:1785945478.855583:0:11094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1785945478.855586:0:11094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b40030000, rc 0) 00000100:00100000:2.0:1785945478.855648:0:11094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a42cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+9:12144:x1872699134605952:12345-192.168.201.47@tcp:101:lfs.0 Request processed in 609us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945478.855655:0:11094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 55 00000100:00100000:0.0:1785945478.858926:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945478.858997:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134606080 00000100:00100000:1.0:1785945478.859006:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134606080 00000100:00100000:1.0:1785945478.859058:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 56 00000100:00100000:1.0:1785945478.859068:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b776ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+9:12144:x1872699134606080:12345-192.168.201.47@tcp:101:lfs.0 00010000:00010000:1.0:1785945478.859086:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945478.859108:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e200/0xf1067778b2c2bdc4 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be4938482b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.859160:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bdcb lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.859171:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bdcb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.859181:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bdcb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785945478.859236:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1785945478.859241:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1785945478.859268:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e200/0xf1067778b2c2bdc4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938482b expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.859284:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bdcb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938482b expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.859292:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff890b760c5f00) 00010000:00010000:1.0:1785945478.859295:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785945478.859297:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7bb7fc00, rc 0) 00000100:00100000:1.0:1785945478.859361:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b776ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+10:12144:x1872699134606080:12345-192.168.201.47@tcp:101:lfs.0 Request processed in 285us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945478.859368:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 56 00000100:00100000:0.0:1785945478.862989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945478.863054:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134606208 00000100:00100000:1.0:1785945478.863062:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134606208 00000100:00100000:1.0:1785945478.863128:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 57 00000100:00100000:1.0:1785945478.863138:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+7:12144:x1872699134606208:12345-192.168.201.47@tcp:101:lfs.0 00010000:00010000:1.0:1785945478.863155:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945478.863172:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bdd2 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be49384832 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.863220:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.863233:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f400/0xf1067778b2c2bd93 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2bd8c expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.863256:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.863285:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f400/0xf1067778b2c2bd93 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xf1067778b2c2bd8c expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785945478.863298:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a436f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6519:1872699165136000:0@lo:104: 00000100:00100000:1.0:1785945478.863341:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945478.863409:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785945478.863461:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165136000 00000100:00100000:3.0:1785945478.863465:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165136000 00000100:00100000:3.0:1785945478.863499:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1785945478.863506:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6519:x1872699165136000:12345-0@lo:104: 00010000:00010000:3.0:1785945478.863517:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7f200/0xf1067778b2c2bd8c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xf1067778b2c2bd93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.863565:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785945478.863571:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6519:x1872699165136000:12345-0@lo:104: Request processed in 66us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945478.863577:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1785945478.863594:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785945478.863599:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7f200/0xf1067778b2c2bd8c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xf1067778b2c2bd93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.863606:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7bb7f200 already unused, calling callback (ffffffffc1762ee0) 00010000:00010000:3.0:1785945478.863611:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7f200/0xf1067778b2c2bd8c lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xf1067778b2c2bd93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785945478.863620:0:9525:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7f200/0xf1067778b2c2bd8c lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xf1067778b2c2bd93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.863642:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7f200/0xf1067778b2c2bd8c lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xf1067778b2c2bd93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.863648:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785945478.863689:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7f200/0xf1067778b2c2bd8c lrc: 1/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xf1067778b2c2bd93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.863697:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7f200/0xf1067778b2c2bd8c lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xf1067778b2c2bd93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.863719:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785945478.863721:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785945478.863723:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785945478.863734:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a42f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165136128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785945478.863762:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785945478.863794:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165136128 00000100:00100000:3.0:1785945478.863798:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165136128 00010000:00010000:3.0:1785945478.863813:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f400/0xf1067778b2c2bd93 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xf1067778b2c2bd8c expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785945478.863831:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1785945478.863837:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a437c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3644:x1872699165136128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785945478.863844:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1785945478.864190:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a436f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6519:1872699165136000:0@lo:104: 00010000:00010000:3.0:1785945478.864207:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1785945478.864349:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:3.0:1785945478.868277:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967309 is committed 00010000:00010000:0.0:1785945478.868448:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f400/0xf1067778b2c2bd93 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xf1067778b2c2bd8c expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.868468:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff890b760c5a00) 00010000:00010000:0.0:1785945478.868473:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.868482:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.868489:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.868517:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785945478.868545:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.868556:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785945478.868621:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1785945478.868626:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1785945478.868641:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a437c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1872699165136128:12345-0@lo:103:ldlm_bl.0 Request processed in 4802us (4875us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945478.868652:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:3.0:1785945478.868695:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7e800/0xf1067778b2c2bdd2 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384832 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.869369:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384832 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.869379:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff890b760c5a00) 00010000:00010000:3.0:1785945478.869382:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785945478.869384:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7bb7f600, rc 0) 00000100:00100000:3.0:1785945478.869476:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:12144:x1872699134606208:12345-192.168.201.47@tcp:101:lfs.0 Request processed in 6338us (6494us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945478.869484:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 57 00000100:00100000:2.0:1785945478.874562:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a42f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165136128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785945478.879468:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945478.880856:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134606336 00000100:00100000:3.0:1785945478.881069:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134606336 00000100:00100000:2.0:1785945478.883460:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 58 00000100:00100000:2.0:1785945478.883472:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:12144:x1872699134606336:12345-192.168.201.47@tcp:101:lfs.0 00010000:00010000:2.0:1785945478.883491:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785945478.883509:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031600/0xf1067778b2c2bde0 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be49384839 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883569:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031a00/0xf1067778b2c2bde7 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883582:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031a00/0xf1067778b2c2bde7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883591:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031a00/0xf1067778b2c2bde7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883623:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bdee lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883630:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bdee lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883654:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bdee lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883747:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031a00/0xf1067778b2c2bde7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883754:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031a00/0xf1067778b2c2bde7 lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883760:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031a00/0xf1067778b2c2bde7 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883766:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b40031a00 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:2.0:1785945478.883770:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031a00/0xf1067778b2c2bde7 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883775:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031a00/0xf1067778b2c2bde7 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883786:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff890b760c5a00) 00010000:00010000:2.0:1785945478.883789:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785945478.883793:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031a00/0xf1067778b2c2bde7 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883799:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031a00/0xf1067778b2c2bde7 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883811:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bdee lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883816:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bdee lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883827:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bdee lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883831:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b40031000 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:2.0:1785945478.883834:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bdee lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883840:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bdee lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883846:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8864fe66 (ffff890a42d7c300) 00010000:00010000:2.0:1785945478.883848:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785945478.883850:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bdee lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883856:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bdee lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883885:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031600/0xf1067778b2c2bde0 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384839 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883893:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff890b760c5a00) 00010000:00010000:2.0:1785945478.883896:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785945478.883899:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031600/0xf1067778b2c2bde0 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384839 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.883907:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b40031600, rc 0) 00000100:00100000:2.0:1785945478.883960:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:12144:x1872699134606336:12345-192.168.201.47@tcp:101:lfs.0 Request processed in 491us (4501us total) trans 0 rc 301/301 00000100:00100000:2.0:1785945478.883975:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 58 00000100:00100000:0.0:1785945478.893867:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945478.893985:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134606464 00000100:00100000:3.0:1785945478.893994:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134606464 00000100:00100000:3.0:1785945478.894049:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 59 00000100:00100000:3.0:1785945478.894058:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+10:12144:x1872699134606464:12345-192.168.201.47@tcp:101:lfs.0 00010000:00010000:3.0:1785945478.894076:0:9394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785945478.894094:0:9394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baebe00/0xf1067778b2c2bdf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be49384840 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.894167:0:9394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baebc00/0xf1067778b2c2bdfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.894179:0:9394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baebc00/0xf1067778b2c2bdfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.894190:0:9394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baebc00/0xf1067778b2c2bdfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785945478.894284:0:9394:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 4096 00000004:00200000:3.0:1785945478.894299:0:9394:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1785945478.894317:0:9394:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baebc00/0xf1067778b2c2bdfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.894341:0:9394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baebe00/0xf1067778b2c2bdf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384840 expref: 12 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.894370:0:9394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baebc00/0xf1067778b2c2bdfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384840 expref: 11 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.894379:0:9394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890a42d7cb00) 00010000:00010000:3.0:1785945478.894381:0:9394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785945478.894385:0:9394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7baebc00, rc 0) 00000100:00100000:3.0:1785945478.894444:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+11:12144:x1872699134606464:12345-192.168.201.47@tcp:101:lfs.0 Request processed in 386us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945478.894451:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 59 00000100:00100000:0.0:1785945478.904591:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945478.904703:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134606720 00000100:00100000:3.0:1785945478.904712:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134606720 00000100:00100000:3.0:1785945478.904764:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 60 00000100:00100000:3.0:1785945478.904774:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+11:12144:x1872699134606720:12345-192.168.201.47@tcp:101:lfs.0 00010000:00010000:3.0:1785945478.904794:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785945478.904813:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baebe00/0xf1067778b2c2be03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be49384847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785945478.904946:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1785945478.905038:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baebe00/0xf1067778b2c2be03 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384847 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.905065:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890b760c5900) 00010000:00010000:3.0:1785945478.905068:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785945478.905074:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baebe00/0xf1067778b2c2be03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384847 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.905087:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7baebe00, rc 0) 00000100:00100000:3.0:1785945478.905135:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+12:12144:x1872699134606720:12345-192.168.201.47@tcp:101:lfs.0 Request processed in 362us (553us total) trans 4294967314 rc 301/301 00000100:00100000:3.0:1785945478.905141:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 60 00000100:00100000:1.0:1785945478.910596:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:0.0:1785945478.910702:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134606976 00000100:00100000:0.0:1785945478.910711:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134606976 00000100:00100000:0.0:1785945478.910767:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 61 00000100:00100000:0.0:1785945478.910777:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+12:12144:x1872699134606976:12345-192.168.201.47@tcp:36:lfs.0 00000100:00100000:0.0:1785945478.910883:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f3d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165136256:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1785945478.910929:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945478.910955:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b44e14480 going to sleep for 11 seconds 00000100:00100000:3.0:1785945478.911086:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165136256 00000100:00100000:3.0:1785945478.911091:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165136256 00000100:00100000:3.0:1785945478.911114:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1785945478.911121:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b6a56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1872699165136256:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785945478.911196:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b6a56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1872699165136256:12345-0@lo:1000:mdt00_002.0 Request processed in 74us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945478.911202:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1785945478.911278:0:6520:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1785945478.911283:0:6520:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967309 00000020:00080000:1.0:1785945478.911288:0:6520:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff890b492313c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1785945478.911292:0:6520:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff890b504f6600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff890b483a0b40 00000020:00080000:1.0:1785945478.911295:0:6520:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].3 00000020:00080000:1.0:1785945478.911298:0:6520:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff890b504f6c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890a43555400 00000020:00080000:1.0:1785945478.911300:0:6520:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].3 00000004:00080000:1.0:1785945478.911329:0:6520:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967308 committed transno 4294967309 00000004:00080000:1.0:1785945478.911336:0:6520:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:1.0:1785945478.911346:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f3d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165136256:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785945478.911395:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a436ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165136384:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785945478.911420:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945478.911447:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a480 going to sleep for 11 seconds 00000020:00080000:2.0:1785945478.911492:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 2 00000020:00080000:2.0:1785945478.911544:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 2 00000100:00100000:3.0:1785945478.911587:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165136384 00000100:00100000:3.0:1785945478.911591:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165136384 00000100:00100000:3.0:1785945478.911617:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1785945478.911623:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1872699165136384:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785945478.911698:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1872699165136384:12345-0@lo:1000:mdt00_002.0 Request processed in 75us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945478.911705:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1785945478.911787:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a436ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165136384:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785945478.911821:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a436ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165136512:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785945478.911851:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945478.911874:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a480 going to sleep for 11 seconds 00000100:00100000:3.0:1785945478.911914:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165136512 00000100:00100000:3.0:1785945478.911918:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165136512 00000100:00100000:3.0:1785945478.911949:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1785945478.911955:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1872699165136512:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785945478.912019:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1872699165136512:12345-0@lo:1000:mdt00_002.0 Request processed in 64us (167us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785945478.912025:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1785945478.912119:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a436ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165136512:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1785945478.912161:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.912171:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.912180:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785945478.912191:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a436ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165136640:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1785945478.912212:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945478.912233:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a000 going to sleep for 11 seconds 00000100:00100000:3.0:1785945478.912378:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165136640 00000100:00100000:3.0:1785945478.912383:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165136640 00000100:00100000:3.0:1785945478.912440:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1785945478.912446:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1872699165136640:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1785945478.912454:0:7466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785945478.912467:0:7466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baebe00/0xf1067778b2c2be18 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf1067778b2c2be11 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.912488:0:7466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384832 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.912498:0:7466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baebe00/0xf1067778b2c2be18 lrc: 4/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xf1067778b2c2be11 expref: 6 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.912518:0:7466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384832 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.912530:0:7466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384832 expref: 7 pid: 6519 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785945478.912541:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a437c5180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:7466:1872699165136768:192.168.201.47@tcp:104: 00000100:00100000:3.0:1785945478.912599:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff890a4369bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1785945478.920366:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a437c5180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:7466:1872699165136768:192.168.201.47@tcp:104: 00010000:00010000:3.0:1785945478.920402:0:7466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baebe00/0xf1067778b2c2be18 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2be11 expref: 6 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.920415:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff890b760c5a00) 00010000:00010000:3.0:1785945478.920417:0:7466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785945478.920421:0:7466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baebe00/0xf1067778b2c2be18 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2be11 expref: 6 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.920431:0:7466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7baebe00, rc 0) 00000100:00100000:3.0:1785945478.920486:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6520:x1872699165136640:12345-0@lo:101:mdt00_002.0 Request processed in 8039us (8272us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945478.920494:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1785945478.920572:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a436ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165136640:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1785945478.920588:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.920598:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785945478.924700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:0.0:1785945478.924791:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134607104 00000100:00100000:0.0:1785945478.924800:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134607104 00010000:00010000:0.0:1785945478.924836:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384832 expref: 8 pid: 6519 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785945478.924869:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 48 00000100:00100000:0.0:1785945478.924878:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:2401:x1872699134607104:12345-192.168.201.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785945478.924892:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785945478.924898:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384832 expref: 8 pid: 6519 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.924909:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384832 expref: 8 pid: 6519 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.924930:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2bdd9 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384832 expref: 8 pid: 6519 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.924946:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff890b760c5a00) 00010000:00010000:0.0:1785945478.924952:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baebe00/0xf1067778b2c2be18 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2be11 expref: 5 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.924975:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baebe00/0xf1067778b2c2be18 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xf1067778b2c2be11 expref: 5 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.924982:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baebe00/0xf1067778b2c2be18 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xf1067778b2c2be11 expref: 5 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.925013:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baebe00/0xf1067778b2c2be18 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2be11 expref: 5 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785945478.925026:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b6a56bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6506:1872699165136896:0@lo:105: 00000100:00100000:0.0:1785945478.925068:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945478.925116:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b44e14300 going to sleep for 11 seconds 00000100:00100000:1.0:1785945478.925172:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165136896 00000100:00100000:1.0:1785945478.925176:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165136896 00000100:00100000:1.0:1785945478.925212:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1785945478.925218:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b6a56b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6506:x1872699165136896:12345-0@lo:105: 00010000:00010000:1.0:1785945478.925228:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.925242:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.925251:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.925258:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.925265:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.925275:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.925297:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff890b7bb7e200) 00000100:00100000:1.0:1785945478.925343:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b6a56b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6506:x1872699165136896:12345-0@lo:105: Request processed in 125us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945478.925359:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1785945478.925480:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b6a56bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6506:1872699165136896:0@lo:105: 00010000:00010000:2.0:1785945478.925496:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785945478.925537:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+7:2401:x1872699134607104:12345-192.168.201.47@tcp:103:ldlm_bl.0 Request processed in 659us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945478.925543:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 48 00010000:00010000:0.0:1785945478.925714:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.925724:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785945478.925743:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1785945478.925776:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff890a440fdc00/0xf1067778b2c2be1f lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.925783:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff890a440fdc00/0xf1067778b2c2be1f lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.925792:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff890a440fdc00/0xf1067778b2c2be1f lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785945478.925806:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b6a56bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165137024:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1785945478.925837:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945478.925860:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b44e14e40 going to sleep for 11 seconds 00000100:00100000:2.0:1785945478.925937:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165137024 00000100:00100000:2.0:1785945478.925941:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165137024 00000100:00100000:2.0:1785945478.925971:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1785945478.925978:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6520:x1872699165137024:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1785945478.925991:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785945478.926004:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031600/0xf1067778b2c2be26 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf1067778b2c2be1f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.926022:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031600/0xf1067778b2c2be26 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xf1067778b2c2be1f expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.926033:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031600/0xf1067778b2c2be26 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2be1f expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945478.926041:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8864fe66 (ffff890a42d7c300) 00010000:00010000:2.0:1785945478.926044:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785945478.926047:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b40031600, rc 0) 00000100:00100000:2.0:1785945478.926088:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6520:x1872699165137024:12345-0@lo:101:mdt00_002.0 Request processed in 110us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945478.926100:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1785945478.926167:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b6a56bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165137024:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1785945478.926178:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff890a440fdc00/0xf1067778b2c2be1f lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2be26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945478.926186:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff890a440fdc00/0xf1067778b2c2be1f lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2be26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785945478.926207:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1785945478.926233:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b6a56bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165137152:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785945478.926258:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945478.926284:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a480 going to sleep for 11 seconds 00000100:00100000:3.0:1785945478.926336:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165137152 00000100:00100000:3.0:1785945478.926340:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165137152 00000100:00100000:3.0:1785945478.926380:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1785945478.926387:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a4368d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6520:x1872699165137152:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785945478.926452:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a4368d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6520:x1872699165137152:12345-0@lo:1000:mdt00_002.0 Request processed in 65us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945478.926458:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1785945478.926518:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b6a56bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165137152:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785945478.926553:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a4368ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165137280:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785945478.926572:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945478.926594:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a480 going to sleep for 11 seconds 00000100:00100000:3.0:1785945478.926636:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165137280 00000100:00100000:3.0:1785945478.926640:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165137280 00000100:00100000:3.0:1785945478.926656:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1785945478.926661:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a4368ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6520:x1872699165137280:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785945478.926759:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a4368ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6520:x1872699165137280:12345-0@lo:1000:mdt00_002.0 Request processed in 97us (185us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785945478.926765:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1785945478.926858:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a4368ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165137280:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785945478.926931:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a4368ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165137408:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785945478.926953:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945478.926972:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a480 going to sleep for 11 seconds 00000100:00100000:3.0:1785945478.927001:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165137408 00000100:00100000:3.0:1785945478.927006:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165137408 00000100:00100000:3.0:1785945478.927026:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1785945478.927032:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b6a56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6520:x1872699165137408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785945478.927095:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b6a56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6520:x1872699165137408:12345-0@lo:1000:mdt00_002.0 Request processed in 63us (141us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785945478.927103:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1785945478.930511:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a4368ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165137408:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785945478.930597:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a4368ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165137536:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785945478.930645:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945478.930692:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a480 going to sleep for 11 seconds 00000100:00100000:2.0:1785945478.930782:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165137536 00000100:00100000:2.0:1785945478.930788:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165137536 00000100:00100000:2.0:1785945478.930823:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1785945478.930831:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6520:x1872699165137536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785945478.930904:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6520:x1872699165137536:12345-0@lo:1000:mdt00_002.0 Request processed in 73us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945478.930910:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1785945478.930936:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a4368ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165137536:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785945478.930972:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a4368ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165137664:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785945478.930995:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945478.931009:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b4dc96c00 going to sleep for 11 seconds 00000100:00100000:2.0:1785945478.931019:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165137664 00000100:00100000:2.0:1785945478.931022:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165137664 00000100:00100000:2.0:1785945478.931039:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1785945478.931044:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a42f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6520:x1872699165137664:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785945478.931100:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a42f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6520:x1872699165137664:12345-0@lo:1000:mdt00_002.0 Request processed in 54us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945478.931106:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1785945478.931127:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a4368ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165137664:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785945478.931161:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a4368ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165137792:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785945478.931181:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945478.931193:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b4dc96c00 going to sleep for 11 seconds 00000100:00100000:2.0:1785945478.931202:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165137792 00000100:00100000:2.0:1785945478.931205:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165137792 00000100:00100000:2.0:1785945478.931232:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1785945478.931238:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a43566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6520:x1872699165137792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785945478.931294:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a43566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6520:x1872699165137792:12345-0@lo:1000:mdt00_002.0 Request processed in 55us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945478.931300:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1785945478.931319:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a4368ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1872699165137792:0@lo:1000:mdt00_002.0 00000040:00080000:2.0:1785945478.931795:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].4, 1080 off38712 00000040:00080000:2.0:1785945478.931842:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].4, 1224 off39336 00000004:00080000:2.0:1785945478.931848:0:6520:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff890b4dc96900 with version 9 00000004:00080000:3.0:1785945478.932125:0:7680:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff890b4dc96d80 version 9 rpc_version 9 00000020:00100000:3.0:1785945478.932146:0:7680:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785945478.932154:0:7680:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff890a437c5180 x1872699165138048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2240/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785945478.932169:0:7680:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a437c5180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7680:1872699165138048:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785945478.932198:0:7680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785945478.932222:0:7680:0:(client.c:2702:ptlrpc_set_wait()) set ffff890a4369bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1785945478.932245:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165138048 00000100:00100000:3.0:1785945478.932249:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165138048 00000100:00100000:3.0:1785945478.932279:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1785945478.932286:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a437c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7680:x1872699165138048:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785945478.932557:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a437c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:7680:x1872699165138048:12345-0@lo:1000:osp_up1-0.0 Request processed in 270us (357us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1785945478.932564:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1785945478.932656:0:7680:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a437c5180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7680:1872699165138048:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1785945478.932823:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeae00/0xf1067778b2c2be2d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.932839:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeae00/0xf1067778b2c2be2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.932849:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeae00/0xf1067778b2c2be2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785945478.932871:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df840776 reply state 000000009876ae47 transno 4294967315 ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeae00/0xf1067778b2c2be2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.932883:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeae00/0xf1067778b2c2be2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.932889:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff890a433b6b00) 00010000:00010000:3.0:1785945478.932892:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785945478.932895:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1785945478.932900:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x5:0x0]: returning size 4096 00000004:00080000:3.0:1785945478.932907:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1785945478.932914:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.932922:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.932929:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.932952:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785945478.932956:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1785945478.932961:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff890a440fdc00/0xf1067778b2c2be1f lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2be26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.932968:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff890a440fdc00/0xf1067778b2c2be1f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2be26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785945478.933039:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+14:12144:x1872699134606976:12345-192.168.201.47@tcp:36:lfs.0 Request processed in 22262us (22450us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1785945478.933053:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 61 00010000:00010000:0.0:1785945478.933227:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785945478.933234:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.933242:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7bb7e200 already unused, calling callback (ffffffffc1762ee0) 00010000:00010000:0.0:1785945478.933247:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785945478.933256:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.933280:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.933286:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785945478.933313:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.933320:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff890b7bb7e200/0xf1067778b2c2be11 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2be18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.933336:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785945478.933338:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785945478.933340:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785945478.933382:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785945478.933394:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a41a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165138176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785945478.933427:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945478.933497:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165138176 00000100:00100000:0.0:1785945478.933502:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165138176 00000100:00100000:0.0:1785945478.933538:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785945478.933545:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b4707f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+8:3644:x1872699165138176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785945478.933562:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785945478.933578:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baebe00/0xf1067778b2c2be18 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xf1067778b2c2be11 expref: 8 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945478.933589:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff890b760c5a00) 00010000:00010000:0.0:1785945478.933595:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785945478.933624:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b4707f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1872699165138176:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945478.933630:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785945478.933696:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a41a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165138176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785945478.941626:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:2.0:1785945478.941759:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134607360 00000100:00100000:2.0:1785945478.941769:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134607360 00000100:00100000:2.0:1785945478.941824:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 8 00000100:00100000:2.0:1785945478.941833:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7502a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+14:12144:x1872699134607360:12345-192.168.201.47@tcp:35:lfs.0 00000100:00100000:2.0:1785945478.942042:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7502a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+15:12144:x1872699134607360:12345-192.168.201.47@tcp:35:lfs.0 Request processed in 209us (423us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1785945478.942051:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 8 00000100:00100000:1.0:1785945478.994282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945478.994391:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134607488 00000100:00100000:3.0:1785945478.994399:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134607488 00000100:00100000:3.0:1785945478.994453:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 62 00000100:00100000:3.0:1785945478.994463:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b75028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+15:12145:x1872699134607488:12345-192.168.201.47@tcp:101:lfs.0 00010000:00010000:3.0:1785945478.994484:0:9394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785945478.994503:0:9394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeac00/0xf1067778b2c2be34 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be4938484e expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994561:0:9394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeba00/0xf1067778b2c2be3b lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994573:0:9394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeba00/0xf1067778b2c2be3b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994585:0:9394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeba00/0xf1067778b2c2be3b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994598:0:9394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeb400/0xf1067778b2c2be42 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994606:0:9394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeb400/0xf1067778b2c2be42 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994613:0:9394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeb400/0xf1067778b2c2be42 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994695:0:9394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeba00/0xf1067778b2c2be3b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994720:0:9394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeba00/0xf1067778b2c2be3b lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994727:0:9394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeba00/0xf1067778b2c2be3b lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994734:0:9394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7baeba00 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:3.0:1785945478.994739:0:9394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeba00/0xf1067778b2c2be3b lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994746:0:9394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeba00/0xf1067778b2c2be3b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994758:0:9394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff890b760c5f00) 00010000:00010000:3.0:1785945478.994761:0:9394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785945478.994765:0:9394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeba00/0xf1067778b2c2be3b lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994772:0:9394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeba00/0xf1067778b2c2be3b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994784:0:9394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeb400/0xf1067778b2c2be42 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994790:0:9394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeb400/0xf1067778b2c2be42 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994797:0:9394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeb400/0xf1067778b2c2be42 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994802:0:9394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7baeb400 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:3.0:1785945478.994810:0:9394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeb400/0xf1067778b2c2be42 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994816:0:9394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeb400/0xf1067778b2c2be42 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994824:0:9394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x79085f7a (ffff890a433b6a00) 00010000:00010000:3.0:1785945478.994826:0:9394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785945478.994829:0:9394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeb400/0xf1067778b2c2be42 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994836:0:9394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeb400/0xf1067778b2c2be42 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994864:0:9394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeac00/0xf1067778b2c2be34 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938484e expref: 16 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994874:0:9394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff890b760c5f00) 00010000:00010000:3.0:1785945478.994876:0:9394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785945478.994880:0:9394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeac00/0xf1067778b2c2be34 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938484e expref: 16 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945478.994888:0:9394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7baeac00, rc 0) 00000100:00100000:3.0:1785945478.994993:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b75028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+15:12145:x1872699134607488:12345-192.168.201.47@tcp:101:lfs.0 Request processed in 531us (719us total) trans 0 rc 301/301 00000100:00100000:3.0:1785945478.995009:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 62 00000100:00100000:1.0:1785945479.002877:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945479.002981:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134607616 00000100:00100000:3.0:1785945479.002990:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134607616 00000100:00100000:3.0:1785945479.003106:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 63 00000100:00100000:3.0:1785945479.003116:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b75028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+7:12145:x1872699134607616:12345-192.168.201.47@tcp:101:lfs.0 00010000:00010000:3.0:1785945479.003141:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785945479.003163:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baea200/0xf1067778b2c2be49 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be49384855 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.003220:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baebe00/0xf1067778b2c2be50 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.003232:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baebe00/0xf1067778b2c2be50 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.003244:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baebe00/0xf1067778b2c2be50 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785945479.003283:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1785945479.003287:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785945479.003319:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baea200/0xf1067778b2c2be49 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384855 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.003335:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baebe00/0xf1067778b2c2be50 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384855 expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.003343:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff890a433b6700) 00010000:00010000:3.0:1785945479.003346:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785945479.003361:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7baebe00, rc 0) 00000100:00100000:3.0:1785945479.003414:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b75028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:12145:x1872699134607616:12345-192.168.201.47@tcp:101:lfs.0 Request processed in 300us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.003420:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 63 00000100:00100000:2.0:1785945479.010271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945479.010384:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134607872 00000100:00100000:3.0:1785945479.010394:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134607872 00000100:00100000:3.0:1785945479.010463:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 64 00000100:00100000:3.0:1785945479.010472:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a4368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+15:12145:x1872699134607872:12345-192.168.201.47@tcp:101:lfs.0 00010000:00010000:3.0:1785945479.010490:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785945479.010507:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeac00/0xf1067778b2c2be57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be4938485c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.010641:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeb400/0xf1067778b2c2be5e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.010653:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeb400/0xf1067778b2c2be5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.010663:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeb400/0xf1067778b2c2be5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785945479.010705:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1785945479.010796:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeac00/0xf1067778b2c2be57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938485c expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.010811:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeb400/0xf1067778b2c2be5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938485c expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.010819:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890a42d7cb00) 00010000:00010000:3.0:1785945479.010821:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785945479.010824:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7baeb400, rc 0) 00000100:00100000:3.0:1785945479.010882:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a4368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+17:12145:x1872699134607872:12345-192.168.201.47@tcp:101:lfs.0 Request processed in 411us (619us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1785945479.010887:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 64 00000100:00100000:0.0:1785945479.023465:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945479.023812:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134608128 00000100:00100000:1.0:1785945479.023821:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134608128 00000100:00100000:1.0:1785945479.023877:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 65 00000100:00100000:1.0:1785945479.023885:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a41a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:12145:x1872699134608128:12345-192.168.201.47@tcp:36:lfs.0 00000100:00100000:1.0:1785945479.024085:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b6b3d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165138304:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.024129:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.024201:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a240 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.024216:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165138304 00000100:00100000:0.0:1785945479.024220:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165138304 00000100:00100000:0.0:1785945479.024250:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1785945479.024256:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a43708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6519:x1872699165138304:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785945479.024326:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a43708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6519:x1872699165138304:12345-0@lo:1000:mdt00_001.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.024333:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1785945479.024421:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b6b3d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165138304:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.024474:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a4370b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165138432:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.024496:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.024521:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a240 going to sleep for 11 seconds 00000100:00100000:2.0:1785945479.025216:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165138432 00000100:00100000:2.0:1785945479.025222:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165138432 00000100:00100000:2.0:1785945479.025256:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1785945479.025263:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b6b3d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6519:x1872699165138432:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785945479.025336:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b6b3d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6519:x1872699165138432:12345-0@lo:1000:mdt00_001.0 Request processed in 73us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945479.025342:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1785945479.028487:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a4370b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165138432:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.028565:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a4370b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165138560:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.028610:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.028661:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a240 going to sleep for 11 seconds 00000100:00100000:2.0:1785945479.030451:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165138560 00000100:00100000:2.0:1785945479.030461:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165138560 00000100:00100000:2.0:1785945479.030530:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1785945479.030539:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a43577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6519:x1872699165138560:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785945479.030654:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a43577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6519:x1872699165138560:12345-0@lo:1000:mdt00_001.0 Request processed in 115us (2042us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785945479.030662:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1785945479.030789:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a4370b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165138560:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1785945479.030846:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.030856:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.030866:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785945479.030880:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a43577800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165138688:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1785945479.030904:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.030948:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.031216:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165138688 00000100:00100000:0.0:1785945479.031221:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165138688 00000100:00100000:0.0:1785945479.031252:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1785945479.031259:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a43575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6519:x1872699165138688:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1785945479.031269:0:7466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785945479.031285:0:7466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fca00/0xf1067778b2c2be73 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf1067778b2c2be6c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.031308:0:7466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bdcb lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938482b expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.031324:0:7466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fca00/0xf1067778b2c2be73 lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xf1067778b2c2be6c expref: 7 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.031345:0:7466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bdcb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938482b expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.031370:0:7466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bdcb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938482b expref: 16 pid: 6520 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785945479.031381:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a41a17100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7466:1872699165138816:192.168.201.47@tcp:104: 00000100:00100000:0.0:1785945479.031440:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b44e14600 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.043326:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:2.0:1785945479.043425:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134608256 00000100:00100000:2.0:1785945479.043434:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134608256 00010000:00010000:2.0:1785945479.043472:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bdcb lrc: 5/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938482b expref: 17 pid: 6520 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785945479.043512:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 49 00000100:00100000:2.0:1785945479.043521:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a41a16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+17:2401:x1872699134608256:12345-192.168.201.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785945479.043538:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785945479.043545:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bdcb lrc: 5/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938482b expref: 17 pid: 6520 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.043558:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bdcb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938482b expref: 17 pid: 6520 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.043579:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff890b760c5f00) 00010000:00010000:2.0:1785945479.043586:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fca00/0xf1067778b2c2be73 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xf1067778b2c2be6c expref: 7 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.043597:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fca00/0xf1067778b2c2be73 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xf1067778b2c2be6c expref: 7 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.043607:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fca00/0xf1067778b2c2be73 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xf1067778b2c2be6c expref: 7 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.043653:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fca00/0xf1067778b2c2be73 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2be6c expref: 7 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785945479.043688:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f404e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6505:1872699165138944:0@lo:105: 00000100:00100000:2.0:1785945479.043731:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.043767:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b4dc96cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785945479.043784:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165138944 00000100:00100000:2.0:1785945479.043788:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165138944 00000100:00100000:2.0:1785945479.043815:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1785945479.043821:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f406680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6505:x1872699165138944:12345-0@lo:105: 00010000:00010000:2.0:1785945479.043830:0:10346:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.043839:0:10346:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.043847:0:10346:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.043854:0:10346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.043861:0:10346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.043871:0:10346:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.043892:0:10346:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff890b7bb7f400) 00000100:00100000:2.0:1785945479.043925:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f406680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6505:x1872699165138944:12345-0@lo:105: Request processed in 103us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945479.043931:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1785945479.043968:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f404e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6505:1872699165138944:0@lo:105: 00010000:00010000:2.0:1785945479.043982:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785945479.044019:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a41a16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+17:2401:x1872699134608256:12345-192.168.201.47@tcp:103:ldlm_bl.0 Request processed in 498us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945479.044025:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 49 00010000:00010000:3.0:1785945479.044298:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2bdcb lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938482b expref: 16 pid: 6520 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785945479.044320:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a41a17100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7466:1872699165138816:192.168.201.47@tcp:104: 00010000:00010000:3.0:1785945479.044339:0:7466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fca00/0xf1067778b2c2be73 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2be6c expref: 7 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.044347:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff890b760c5f00) 00010000:00010000:3.0:1785945479.044359:0:7466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785945479.044363:0:7466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890a440fca00, rc 0) 00000100:00100000:3.0:1785945479.044404:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a43575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6519:x1872699165138688:12345-0@lo:101:mdt00_001.0 Request processed in 13145us (13499us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.044411:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1785945479.045851:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a43577800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165138688:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1785945479.045868:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785945479.045889:0:6519:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1785945479.045926:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7e800/0xf1067778b2c2be7a lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.045934:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7e800/0xf1067778b2c2be7a lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.045944:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7e800/0xf1067778b2c2be7a lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785945479.045958:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a43577800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165139072:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1785945479.045992:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.046081:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.046395:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165139072 00000100:00100000:0.0:1785945479.046401:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165139072 00000100:00100000:0.0:1785945479.046439:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1785945479.046447:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a43575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6519:x1872699165139072:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1785945479.046461:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785945479.046475:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd800/0xf1067778b2c2be81 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf1067778b2c2be7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.046494:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd800/0xf1067778b2c2be81 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xf1067778b2c2be7a expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.046506:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd800/0xf1067778b2c2be81 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2be7a expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.046526:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x79085f7a (ffff890b470a0b00) 00010000:00010000:0.0:1785945479.046529:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785945479.046532:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890a440fd800, rc 0) 00000100:00100000:0.0:1785945479.046569:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a43575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6519:x1872699165139072:12345-0@lo:101:mdt00_001.0 Request processed in 123us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.046576:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1785945479.046854:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a43577800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165139072:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1785945479.046866:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7e800/0xf1067778b2c2be7a lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2be81 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.046875:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7e800/0xf1067778b2c2be7a lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2be81 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785945479.046886:0:6519:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:1.0:1785945479.046912:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a43577800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165139200:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.046935:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.046967:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a240 going to sleep for 11 seconds 00000100:00100000:3.0:1785945479.047207:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165139200 00000100:00100000:3.0:1785945479.047211:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165139200 00000100:00100000:3.0:1785945479.047243:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1785945479.047249:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a4370b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6519:x1872699165139200:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785945479.047325:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a4370b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6519:x1872699165139200:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.047333:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1785945479.047395:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a43577800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165139200:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.047433:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a43577800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165139328:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.047456:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.047480:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a240 going to sleep for 11 seconds 00000100:00100000:2.0:1785945479.047763:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165139328 00000100:00100000:2.0:1785945479.047768:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165139328 00000100:00100000:2.0:1785945479.047803:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1785945479.047810:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6519:x1872699165139328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785945479.047883:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6519:x1872699165139328:12345-0@lo:1000:mdt00_001.0 Request processed in 73us (424us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785945479.047890:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1785945479.048096:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a43577800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165139328:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.048157:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f4a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165139456:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.048179:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.048203:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a240 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.048390:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165139456 00000100:00100000:0.0:1785945479.048394:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165139456 00000100:00100000:0.0:1785945479.048424:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1785945479.048430:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6519:x1872699165139456:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785945479.048495:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6519:x1872699165139456:12345-0@lo:1000:mdt00_001.0 Request processed in 65us (314us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785945479.048501:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1785945479.048976:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f4a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165139456:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.049114:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f4a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165139584:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.049137:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.049161:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a240 going to sleep for 11 seconds 00000100:00100000:3.0:1785945479.049211:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165139584 00000100:00100000:3.0:1785945479.049217:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165139584 00000100:00100000:3.0:1785945479.049247:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1785945479.049254:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6519:x1872699165139584:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785945479.049310:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6519:x1872699165139584:12345-0@lo:1000:mdt00_001.0 Request processed in 57us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.049317:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1785945479.049387:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f4a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165139584:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.049425:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f4a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165139712:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.049450:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.049473:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a240 going to sleep for 11 seconds 00000100:00100000:2.0:1785945479.049512:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165139712 00000100:00100000:2.0:1785945479.049517:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165139712 00000100:00100000:2.0:1785945479.049547:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1785945479.049553:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b74aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6519:x1872699165139712:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785945479.049612:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b74aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6519:x1872699165139712:12345-0@lo:1000:mdt00_001.0 Request processed in 59us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945479.049618:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1785945479.049804:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f4a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165139712:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.049839:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f4a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165139840:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785945479.049910:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.049934:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a240 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.050387:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165139840 00000100:00100000:0.0:1785945479.050392:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165139840 00000100:00100000:0.0:1785945479.050421:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1785945479.050428:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6519:x1872699165139840:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785945479.050486:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6519:x1872699165139840:12345-0@lo:1000:mdt00_001.0 Request processed in 59us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.050492:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1785945479.050804:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f4a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1872699165139840:0@lo:1000:mdt00_001.0 00000040:00080000:1.0:1785945479.050949:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785945479.051083:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].1, 64 off32832 00000004:00080000:1.0:1785945479.051090:0:6519:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff890b5004ad80 with version 2 00000040:00080000:1.0:1785945479.051147:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785945479.051157:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].2, 64 off32896 00000004:00080000:1.0:1785945479.051161:0:6519:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff890b5004a600 with version 3 00000004:00080000:2.0:1785945479.051213:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff890b750c36c0 version 2 rpc_version 2 00000020:00100000:2.0:1785945479.051236:0:7464:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785945479.051248:0:7464:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff890b7f404e00 x1872699165140096/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785945479.051263:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f404e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1872699165140096:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1785945479.051297:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.051323:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b4dc96b40 going to sleep for 11 seconds 00000100:00100000:3.0:1785945479.051388:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165140096 00000100:00100000:3.0:1785945479.051397:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165140096 00000100:00100000:3.0:1785945479.051429:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1785945479.051436:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7464:x1872699165140096:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:1.0:1785945479.051627:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785945479.053302:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].1, 64 off32832 00000040:00080000:1.0:1785945479.053505:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].1, 1080 off33848 00000040:00080000:1.0:1785945479.053590:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].1, 1224 off33992 00000004:00080000:1.0:1785945479.053596:0:6519:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff890b5004a3c0 with version 4 00010000:00010000:0.0:1785945479.055285:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff890a440fdc00/0xf1067778b2c2be1f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xf1067778b2c2be26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785945479.055300:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff890a440fdc00/0xf1067778b2c2be1f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xf1067778b2c2be26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.055361:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff890a440fdc00/0xf1067778b2c2be1f lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2be26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.055369:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785945479.055401:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff890a440fdc00/0xf1067778b2c2be1f lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2be26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785945479.055421:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967318 is committed 00000001:00080000:0.0:1785945479.055442:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967317 is committed 00000020:00080000:0.0:1785945479.055452:0:6498:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:2.0:1785945479.055528:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a41a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872699165140224:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1785945479.055565:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945479.055577:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7464:x1872699165140096:12345-0@lo:1000:osp_up0-1.0 Request processed in 4140us (4278us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1785945479.055586:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000020:00080000:2.0:1785945479.055603:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000004:00080000:2.0:1785945479.055648:0:6550:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff890b492db000 with version 10 00000020:00080000:2.0:1785945479.055685:0:6550:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 3 cancel update log [0x240000401:0x3:0x0].3: rc = 0 00010000:00010000:1.0:1785945479.055695:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeae00/0xf1067778b2c2be2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.055703:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeae00/0xf1067778b2c2be2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.055710:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeae00/0xf1067778b2c2be2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.055716:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7baeae00 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945479.055720:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeae00/0xf1067778b2c2be2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.055727:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeae00/0xf1067778b2c2be2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.055738:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff890a433b6b00) 00010000:00010000:1.0:1785945479.055740:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945479.055744:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeae00/0xf1067778b2c2be2d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.055750:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeae00/0xf1067778b2c2be2d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1785945479.055753:0:6550:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 3 cancel update log [0x200000400:0x3:0x0].3: rc = 0 00000020:00080000:2.0:1785945479.055759:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000004:00080000:2.0:1785945479.055788:0:7464:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:2.0:1785945479.055793:0:7464:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967318 gen 2 00000100:00100000:2.0:1785945479.055808:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f404e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1872699165140096:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1785945479.055821:0:7680:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff890b4dc96d80 version 10 rpc_version 10 00000020:00100000:0.0:1785945479.055837:0:7680:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000004:00080000:2.0:1785945479.055844:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff890b750c36c0 version 3 rpc_version 3 00000100:00100000:0.0:1785945479.055844:0:7680:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff890a41a17100 x1872699165140480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00100000:2.0:1785945479.055857:0:7464:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785945479.055859:0:7680:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a41a17100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7680:1872699165140480:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785945479.055861:0:7464:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff890a434a4000 x1872699165140736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785945479.055872:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a434a4000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1872699165140736:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785945479.055887:0:7680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.055900:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165140224 00000100:00100000:2.0:1785945479.055906:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165140224 00000100:00100000:0.0:1785945479.055906:0:7680:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b44e14f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785945479.055951:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785945479.055960:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a434a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1872699165140224:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1785945479.055972:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785945479.055995:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031600/0xf1067778b2c2be26 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xf1067778b2c2be1f expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.056008:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8864fe66 (ffff890a42d7c300) 00010000:00010000:2.0:1785945479.056014:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785945479.056053:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a434a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1872699165140224:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 94us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945479.056060:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785945479.056079:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945479.056083:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a41a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872699165140224:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1785945479.056104:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785945479.056117:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165140480 00000100:00100000:2.0:1785945479.056121:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165140480 00000100:00100000:1.0:1785945479.056123:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165140736 00000100:00100000:1.0:1785945479.056133:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165140736 00000100:00100000:2.0:1785945479.056152:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1785945479.056193:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a41a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7680:x1872699165140480:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785945479.056294:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a41a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7680:x1872699165140480:12345-0@lo:1000:osp_up1-0.0 Request processed in 135us (405us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1785945479.057127:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1785945479.057138:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a434a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7464:x1872699165140736:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785945479.060300:0:7680:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a41a17100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7680:1872699165140480:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785945479.062476:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000001:00080000:0.0:1785945479.067751:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967319 is committed 00000100:00100000:1.0:1785945479.067948:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a434a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7464:x1872699165140736:12345-0@lo:1000:osp_up0-1.0 Request processed in 10810us (11864us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1785945479.067960:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000004:00080000:2.0:1785945479.068234:0:7464:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967319 committed transno 4294967319 00000100:00100000:2.0:1785945479.068239:0:7464:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967319 gen 2 00000100:00100000:2.0:1785945479.068256:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a434a4000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1872699165140736:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1785945479.068280:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff890b750c36c0 version 4 rpc_version 4 00000020:00100000:2.0:1785945479.068307:0:7464:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785945479.068314:0:7464:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff890a434a4000 x1872699165140992/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785945479.068334:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a434a4000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1872699165140992:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1785945479.068384:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.068413:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.069075:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165140992 00000100:00100000:0.0:1785945479.069082:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165140992 00000100:00100000:0.0:1785945479.069123:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1785945479.069137:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7464:x1872699165140992:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785945479.069944:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7464:x1872699165140992:12345-0@lo:1000:osp_up0-1.0 Request processed in 807us (1558us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1785945479.069952:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1785945479.070425:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a434a4000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1872699165140992:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1785945479.071106:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2be88 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.071122:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2be88 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.071133:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2be88 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785945479.071147:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000023bef9e reply state 000000004af82998 transno 4294967311 ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2be88 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.071157:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7fc00/0xf1067778b2c2be88 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.071163:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff890b760c5c00) 00010000:00010000:1.0:1785945479.071165:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785945479.071168:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1785945479.071173:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x3:0x0]: returning size 4096 00000004:00080000:1.0:1785945479.071180:0:6519:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1785945479.071189:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.071197:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.071215:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.071238:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1785945479.071243:0:6519:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1785945479.071248:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7e800/0xf1067778b2c2be7a lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2be81 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.071253:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7e800/0xf1067778b2c2be7a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2be81 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785945479.071328:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a41a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+10:12145:x1872699134608128:12345-192.168.201.47@tcp:36:lfs.0 Request processed in 47442us (47870us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1785945479.071336:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 65 00010000:00010000:3.0:1785945479.071385:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785945479.071391:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.071399:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7bb7f400 already unused, calling callback (ffffffffc1762ee0) 00010000:00010000:3.0:1785945479.071404:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785945479.071412:0:6507:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.071442:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.071449:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785945479.071483:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.071491:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7f400/0xf1067778b2c2be6c lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2be73 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.071506:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785945479.071508:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785945479.071510:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785945479.072129:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785945479.072143:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a437c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872699165141120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785945479.072182:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.072803:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165141120 00000100:00100000:2.0:1785945479.072810:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165141120 00000100:00100000:2.0:1785945479.072853:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785945479.072862:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3646:x1872699165141120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785945479.072874:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785945479.072890:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fca00/0xf1067778b2c2be73 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xf1067778b2c2be6c expref: 9 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.072903:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff890b760c5f00) 00010000:00010000:2.0:1785945479.072910:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785945479.072948:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3646:x1872699165141120:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945479.072954:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785945479.074322:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a437c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872699165141120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785945479.088739:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945479.088853:0:11094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134608384 00000100:00100000:1.0:1785945479.088861:0:11094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134608384 00000100:00100000:1.0:1785945479.088919:0:11094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 66 00000100:00100000:1.0:1785945479.088928:0:11094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a41a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+10:11987:x1872699134608384:12345-192.168.201.47@tcp:101:bash.0 00010000:00010000:1.0:1785945479.088951:0:11094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945479.088970:0:11094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2be8f lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be49384863 expref: -99 pid: 11094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089054:0:11094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f200/0xf1067778b2c2be96 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089067:0:11094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f200/0xf1067778b2c2be96 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089077:0:11094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f200/0xf1067778b2c2be96 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089092:0:11094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7e200/0xf1067778b2c2be9d lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089098:0:11094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7e200/0xf1067778b2c2be9d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089103:0:11094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7e200/0xf1067778b2c2be9d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785945479.089208:0:11094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f4a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:11094:1872699165141248:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785945479.089257:0:11094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.089301:0:11094:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a840 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.089408:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165141248 00000100:00100000:0.0:1785945479.089413:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165141248 00000100:00100000:0.0:1785945479.089449:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1785945479.089456:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:11094:x1872699165141248:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785945479.089531:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:11094:x1872699165141248:12345-0@lo:1000:mdt00_004.0 Request processed in 75us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.089538:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1785945479.089613:0:11094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f4a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:11094:1872699165141248:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1785945479.089647:0:11094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f400/0xf1067778b2c2bea4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089655:0:11094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f400/0xf1067778b2c2bea4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089662:0:11094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f400/0xf1067778b2c2bea4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785945479.089801:0:11094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f400/0xf1067778b2c2bea4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089814:0:11094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f200/0xf1067778b2c2be96 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089820:0:11094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f200/0xf1067778b2c2be96 lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089827:0:11094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f200/0xf1067778b2c2be96 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089832:0:11094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7bb7f200 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945479.089835:0:11094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f200/0xf1067778b2c2be96 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089842:0:11094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f200/0xf1067778b2c2be96 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089853:0:11094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff890a433b6700) 00010000:00010000:1.0:1785945479.089856:0:11094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945479.089860:0:11094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f200/0xf1067778b2c2be96 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089865:0:11094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f200/0xf1067778b2c2be96 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089876:0:11094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7e200/0xf1067778b2c2be9d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089881:0:11094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7e200/0xf1067778b2c2be9d lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089893:0:11094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7e200/0xf1067778b2c2be9d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089898:0:11094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7bb7e200 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945479.089901:0:11094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7e200/0xf1067778b2c2be9d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089906:0:11094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7e200/0xf1067778b2c2be9d lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089912:0:11094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8864fe66 (ffff890b760c5800) 00010000:00010000:1.0:1785945479.089915:0:11094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945479.089917:0:11094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7e200/0xf1067778b2c2be9d lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089923:0:11094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7e200/0xf1067778b2c2be9d lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089951:0:11094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f600/0xf1067778b2c2be8f lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384863 expref: 12 pid: 11094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089962:0:11094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7bb7f400/0xf1067778b2c2bea4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384863 expref: 11 pid: 11094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.089969:0:11094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff890b760c5d00) 00010000:00010000:1.0:1785945479.089971:0:11094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785945479.089973:0:11094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7bb7f400, rc 0) 00000100:00100000:1.0:1785945479.090019:0:11094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a41a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+11:11987:x1872699134608384:12345-192.168.201.47@tcp:101:bash.0 Request processed in 1092us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945479.090034:0:11094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 66 00000100:00100000:2.0:1785945479.099485:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945479.099584:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134608512 00000100:00100000:1.0:1785945479.099593:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134608512 00000100:00100000:1.0:1785945479.099650:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 67 00000100:00100000:1.0:1785945479.099659:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7a4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+11:11987:x1872699134608512:12345-192.168.201.47@tcp:101:bash.0 00010000:00010000:1.0:1785945479.099710:0:9394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945479.099732:0:9394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f600/0xf1067778b2c2beab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be4938486a expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.099793:0:9394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e200/0xf1067778b2c2beb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.099807:0:9394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e200/0xf1067778b2c2beb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.099819:0:9394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e200/0xf1067778b2c2beb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9394 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785945479.099864:0:9394:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1785945479.099868:0:9394:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1785945479.099901:0:9394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f600/0xf1067778b2c2beab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938486a expref: 13 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.099918:0:9394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7e200/0xf1067778b2c2beb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938486a expref: 12 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.099928:0:9394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff890b760c5800) 00010000:00010000:1.0:1785945479.099931:0:9394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1785945479.099947:0:9394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7bb7e200, rc 0) 00000100:00100000:1.0:1785945479.099997:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7a4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+12:11987:x1872699134608512:12345-192.168.201.47@tcp:101:bash.0 Request processed in 339us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945479.100004:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 67 00000100:00100000:0.0:1785945479.106594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945479.107520:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134608768 00000100:00100000:1.0:1785945479.107531:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134608768 00000100:00100000:1.0:1785945479.107590:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 68 00000100:00100000:1.0:1785945479.107600:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a41a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+12:11987:x1872699134608768:12345-192.168.201.47@tcp:101:bash.0 00010000:00010000:1.0:1785945479.107619:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945479.107637:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f600/0xf1067778b2c2beb9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be49384871 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.107761:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bec0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.107776:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bec0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.107787:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bec0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.107803:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bc200/0xf1067778b2c2bec7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.107810:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bc200/0xf1067778b2c2bec7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.107816:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bc200/0xf1067778b2c2bec7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785945479.108167:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1785945479.108289:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bda00/0xf1067778b2c2bece lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.108299:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bda00/0xf1067778b2c2bece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.108306:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bda00/0xf1067778b2c2bece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.108336:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bec0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.108344:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bec0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.108363:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bec0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.108370:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bec0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.108377:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7bb7f200 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945479.108381:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bec0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.108389:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bec0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.108400:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff890b760c5800) 00010000:00010000:1.0:1785945479.108403:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945479.108407:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bec0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.108423:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bec0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785945479.108435:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc536bf4 reply state 000000007c174c1b transno 4294967321 ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bc200/0xf1067778b2c2bec7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.108446:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bc200/0xf1067778b2c2bec7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.108452:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x1c2f8c79 (ffff890b760c5700) 00010000:00010000:1.0:1785945479.108454:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785945479.108457:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785945479.108481:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f600/0xf1067778b2c2beb9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384871 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.108494:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bda00/0xf1067778b2c2bece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384871 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.108500:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890b760c5300) 00010000:00010000:1.0:1785945479.108503:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785945479.108505:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b4d7bda00, rc 0) 00000100:00100000:1.0:1785945479.108570:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a41a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+15:11987:x1872699134608768:12345-192.168.201.47@tcp:101:bash.0 Request processed in 972us (1985us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1785945479.108577:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 68 00000100:00100000:0.0:1785945479.122512:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945479.122616:0:9395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134608896 00000100:00100000:1.0:1785945479.122625:0:9395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134608896 00000100:00100000:1.0:1785945479.122722:0:9395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 28 00000100:00100000:1.0:1785945479.122733:0:9395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a41a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+6:11987:x1872699134608896:12345-192.168.201.47@tcp:101:bash.0 00010000:00010000:1.0:1785945479.122760:0:9395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945479.122783:0:9395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000814107ed/0xf1067778b2c2bedc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be49384878 expref: -99 pid: 9395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785945479.122808:0:9395:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785945479.122828:0:9395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1785945479.122832:0:9395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785945479.122841:0:9395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000814107ed/0xf1067778b2c2bedc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384878 expref: 7 pid: 9395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.122859:0:9395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000814107ed/0xf1067778b2c2bedc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384878 expref: 7 pid: 9395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.122872:0:9395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7bb7f600, rc 0) 00000100:00100000:1.0:1785945479.122933:0:9395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a41a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+7:11987:x1872699134608896:12345-192.168.201.47@tcp:101:bash.0 Request processed in 203us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945479.122940:0:9395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 28 00000100:00080000:0.0:1785945479.122997:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785945479.131474:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:0.0:1785945479.131578:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134609152 00000100:00100000:0.0:1785945479.131588:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134609152 00000100:00100000:0.0:1785945479.131644:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 9 00000100:00100000:0.0:1785945479.131654:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+15:11987:x1872699134609152:12345-192.168.201.47@tcp:35:bash.0 00000100:00100000:0.0:1785945479.131954:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+16:11987:x1872699134609152:12345-192.168.201.47@tcp:35:bash.0 Request processed in 301us (489us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1785945479.131961:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 9 00000100:00100000:3.0:1785945479.138938:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945479.139045:0:11094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134609280 00000100:00100000:1.0:1785945479.139054:0:11094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134609280 00000100:00100000:1.0:1785945479.139118:0:11094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 69 00000100:00100000:1.0:1785945479.139128:0:11094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a437c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+16:11987:x1872699134609280:12345-192.168.201.47@tcp:101:bash.0 00010000:00010000:1.0:1785945479.139151:0:11094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945479.139171:0:11094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bee3 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be4938487f expref: -99 pid: 11094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.139238:0:11094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b82165200/0xf1067778b2c2beea lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.139257:0:11094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b82165200/0xf1067778b2c2beea lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.139269:0:11094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b82165200/0xf1067778b2c2beea lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.139280:0:11094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164600/0xf1067778b2c2bef1 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.139291:0:11094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd800/0xf1067778b2c2be81 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2be7a expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.139300:0:11094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164600/0xf1067778b2c2bef1 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.139329:0:11094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd800/0xf1067778b2c2be81 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xf1067778b2c2be7a expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785945479.139344:0:11094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f4a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11094:1872699165141376:0@lo:104: 00000100:00100000:1.0:1785945479.139400:0:11094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.139473:0:11094:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a840 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.139574:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165141376 00000100:00100000:0.0:1785945479.139578:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165141376 00000100:00100000:0.0:1785945479.139612:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1785945479.139619:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:11094:x1872699165141376:12345-0@lo:104: 00010000:00010000:0.0:1785945479.139638:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7e800/0xf1067778b2c2be7a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xf1067778b2c2be81 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.139714:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785945479.139720:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:11094:x1872699165141376:12345-0@lo:104: Request processed in 103us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.139727:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:3.0:1785945479.139823:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785945479.139829:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7e800/0xf1067778b2c2be7a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xf1067778b2c2be81 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.139838:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7bb7e800 already unused, calling callback (ffffffffc1762ee0) 00010000:00010000:3.0:1785945479.139843:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7e800/0xf1067778b2c2be7a lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xf1067778b2c2be81 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785945479.139852:0:9525:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7e800/0xf1067778b2c2be7a lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xf1067778b2c2be81 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.139876:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7e800/0xf1067778b2c2be7a lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xf1067778b2c2be81 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.139883:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785945479.139909:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7e800/0xf1067778b2c2be7a lrc: 1/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xf1067778b2c2be81 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.139917:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b7bb7e800/0xf1067778b2c2be7a lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xf1067778b2c2be81 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.139934:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785945479.139936:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785945479.139938:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785945479.139979:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785945479.139992:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a437c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872699165141504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785945479.140024:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785945479.140129:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165141504 00000100:00100000:3.0:1785945479.140133:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165141504 00010000:00010000:3.0:1785945479.140151:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd800/0xf1067778b2c2be81 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xf1067778b2c2be7a expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785945479.140177:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1785945479.140189:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3645:x1872699165141504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785945479.140198:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1785945479.140706:0:11094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f4a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11094:1872699165141376:0@lo:104: 00010000:00010000:1.0:1785945479.140723:0:11094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164600/0xf1067778b2c2bef1 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785945479.142367:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967322 is committed 00000001:00080000:0.0:1785945479.142380:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967320 is committed 00010000:00010000:2.0:1785945479.142446:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bc200/0xf1067778b2c2bec7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.142455:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bc200/0xf1067778b2c2bec7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.142461:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bc200/0xf1067778b2c2bec7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.142466:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b4d7bc200 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:2.0:1785945479.142470:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bc200/0xf1067778b2c2bec7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.142484:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bc200/0xf1067778b2c2bec7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.142497:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x1c2f8c79 (ffff890b760c5700) 00010000:00010000:2.0:1785945479.142499:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785945479.142503:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bc200/0xf1067778b2c2bec7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.142508:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bc200/0xf1067778b2c2bec7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.146496:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890a440fd800/0xf1067778b2c2be81 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xf1067778b2c2be7a expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.146518:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x79085f7a (ffff890b470a0b00) 00010000:00010000:3.0:1785945479.146523:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164600/0xf1067778b2c2bef1 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.146533:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164600/0xf1067778b2c2bef1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.146540:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164600/0xf1067778b2c2bef1 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.146572:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785945479.146656:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3645:x1872699165141504:12345-0@lo:103:ldlm_bl.0 Request processed in 6465us (6629us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.146665:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1785945479.146795:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a437c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872699165141504:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785945479.146888:0:11094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164600/0xf1067778b2c2bef1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.146896:0:11094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164600/0xf1067778b2c2bef1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785945479.147028:0:11094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f4a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11094:1872699165141632:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785945479.147071:0:11094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.147112:0:11094:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a000 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.147125:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165141632 00000100:00100000:0.0:1785945479.147132:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165141632 00000100:00100000:0.0:1785945479.147176:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1785945479.147186:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:11094:x1872699165141632:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785945479.147267:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:11094:x1872699165141632:12345-0@lo:1000:mdt00_004.0 Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.147274:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1785945479.147391:0:11094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f4a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11094:1872699165141632:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1785945479.147431:0:11094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164400/0xf1067778b2c2bef8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147442:0:11094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164400/0xf1067778b2c2bef8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147450:0:11094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164400/0xf1067778b2c2bef8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785945479.147469:0:11094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164400/0xf1067778b2c2bef8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147480:0:11094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b82165200/0xf1067778b2c2beea lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147487:0:11094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b82165200/0xf1067778b2c2beea lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147493:0:11094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b82165200/0xf1067778b2c2beea lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147498:0:11094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b82165200 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945479.147501:0:11094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b82165200/0xf1067778b2c2beea lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147508:0:11094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b82165200/0xf1067778b2c2beea lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147523:0:11094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff890b760c5600) 00010000:00010000:1.0:1785945479.147525:0:11094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945479.147529:0:11094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b82165200/0xf1067778b2c2beea lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147535:0:11094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b82165200/0xf1067778b2c2beea lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147546:0:11094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164600/0xf1067778b2c2bef1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147551:0:11094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164600/0xf1067778b2c2bef1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147557:0:11094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164600/0xf1067778b2c2bef1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147561:0:11094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b82164600 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945479.147564:0:11094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164600/0xf1067778b2c2bef1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147569:0:11094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164600/0xf1067778b2c2bef1 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147574:0:11094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x79085f7a (ffff890b470a0b00) 00010000:00010000:1.0:1785945479.147577:0:11094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945479.147579:0:11094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164600/0xf1067778b2c2bef1 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147585:0:11094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164600/0xf1067778b2c2bef1 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147627:0:11094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7bb7f200/0xf1067778b2c2bee3 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938487f expref: 15 pid: 11094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147643:0:11094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b82164400/0xf1067778b2c2bef8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938487f expref: 14 pid: 11094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.147650:0:11094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff890b760c5f00) 00010000:00010000:1.0:1785945479.147652:0:11094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785945479.147654:0:11094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b82164400, rc 0) 00000100:00100000:1.0:1785945479.147725:0:11094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a437c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+14:11987:x1872699134609280:12345-192.168.201.47@tcp:101:bash.0 Request processed in 8599us (8796us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945479.147732:0:11094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 69 00000100:00100000:1.0:1785945479.157460:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945479.157552:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134609408 00000100:00100000:3.0:1785945479.157563:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134609408 00000100:00100000:3.0:1785945479.157619:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 70 00000100:00100000:3.0:1785945479.157630:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+11:11987:x1872699134609408:12345-192.168.201.47@tcp:101:bash.0 00010000:00010000:3.0:1785945479.157651:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785945479.157711:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baeac00/0xf1067778b2c2beff lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be49384886 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.157774:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baea200/0xf1067778b2c2bf06 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.157805:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baea200/0xf1067778b2c2bf06 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.157817:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baea200/0xf1067778b2c2bf06 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785945479.157860:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1785945479.157864:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1785945479.157903:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baeac00/0xf1067778b2c2beff lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384886 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.157919:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baea200/0xf1067778b2c2bf06 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384886 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.157927:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff890b760c5c00) 00010000:00010000:3.0:1785945479.157930:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1785945479.157933:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7baea200, rc 0) 00000100:00100000:3.0:1785945479.157990:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+12:11987:x1872699134609408:12345-192.168.201.47@tcp:101:bash.0 Request processed in 362us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.157997:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 70 00000100:00100000:2.0:1785945479.162286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945479.164448:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134609664 00000100:00100000:1.0:1785945479.164460:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134609664 00000100:00100000:1.0:1785945479.164517:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 71 00000100:00100000:1.0:1785945479.164527:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+12:11987:x1872699134609664:12345-192.168.201.47@tcp:101:bash.0 00010000:00010000:1.0:1785945479.164546:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945479.164563:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b82164600/0xf1067778b2c2bf0d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be4938488d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.164658:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165200/0xf1067778b2c2bf14 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.164687:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165200/0xf1067778b2c2bf14 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.164716:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165200/0xf1067778b2c2bf14 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.164777:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165000/0xf1067778b2c2bf1b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x3:0x0].0x4aadbd0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.164785:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165000/0xf1067778b2c2bf1b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x4aadbd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.164792:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165000/0xf1067778b2c2bf1b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x4aadbd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785945479.165113:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1785945479.165245:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65b000/0xf1067778b2c2bf22 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.165254:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65b000/0xf1067778b2c2bf22 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.165261:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65b000/0xf1067778b2c2bf22 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.165291:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165200/0xf1067778b2c2bf14 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.165298:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165200/0xf1067778b2c2bf14 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.165303:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165200/0xf1067778b2c2bf14 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.165310:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165200/0xf1067778b2c2bf14 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.165320:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b82165200 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945479.165325:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165200/0xf1067778b2c2bf14 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.165332:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165200/0xf1067778b2c2bf14 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.165343:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff890b760c5c00) 00010000:00010000:1.0:1785945479.165357:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945479.165362:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165200/0xf1067778b2c2bf14 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.165369:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165200/0xf1067778b2c2bf14 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785945479.165383:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007dd63ca5 reply state 000000008703d02e transno 4294967313 ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165000/0xf1067778b2c2bf1b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x4aadbd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.165393:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b82165000/0xf1067778b2c2bf1b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x4aadbd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.165398:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x4aadbd0b (ffff890b760c5600) 00010000:00010000:1.0:1785945479.165401:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785945479.165403:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785945479.165426:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b82164600/0xf1067778b2c2bf0d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938488d expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.165439:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65b000/0xf1067778b2c2bf22 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938488d expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.165456:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff890b760c5a00) 00010000:00010000:1.0:1785945479.165459:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785945479.165461:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b4a65b000, rc 0) 00000100:00100000:1.0:1785945479.165523:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+15:11987:x1872699134609664:12345-192.168.201.47@tcp:101:bash.0 Request processed in 998us (3245us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1785945479.165530:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 71 00000100:00100000:0.0:1785945479.183155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945479.183403:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134609792 00000100:00100000:1.0:1785945479.183413:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134609792 00000100:00100000:1.0:1785945479.183475:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 29 00000100:00100000:1.0:1785945479.183485:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a433ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+7:11987:x1872699134609792:12345-192.168.201.47@tcp:101:bash.0 00010000:00010000:1.0:1785945479.183502:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945479.183521:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ae46407/0xf1067778b2c2bf30 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be49384894 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785945479.183545:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785945479.183566:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1785945479.183571:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785945479.183581:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ae46407/0xf1067778b2c2bf30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384894 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.183596:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ae46407/0xf1067778b2c2bf30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384894 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.183608:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b4a65be00, rc 0) 00000100:00100000:1.0:1785945479.183665:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a433ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:11987:x1872699134609792:12345-192.168.201.47@tcp:101:bash.0 Request processed in 182us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945479.183716:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 29 00000100:00100000:0.0:1785945479.195886:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:2.0:1785945479.196231:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134610048 00000100:00100000:2.0:1785945479.196240:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134610048 00000100:00100000:2.0:1785945479.196296:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 10 00000100:00100000:2.0:1785945479.196305:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b49602450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+15:11987:x1872699134610048:12345-192.168.201.47@tcp:35:bash.0 00000100:00100000:2.0:1785945479.196588:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b49602450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+16:11987:x1872699134610048:12345-192.168.201.47@tcp:35:bash.0 Request processed in 284us (709us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1785945479.196595:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 10 00010000:00010000:0.0:1785945479.209080:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785945479.336977:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a43577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872699165141760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785945479.337048:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945479.337214:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165141760 00000100:00100000:0.0:1785945479.337221:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165141760 00000100:00100000:0.0:1785945479.337278:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1785945479.337288:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872699165141760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785945479.337316:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00080000:1.0:1785945479.337395:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785945479.337495:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785945479.337506:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a437c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872699165141888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785945479.337535:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785945479.337563:0:9960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165141888 00000100:00100000:3.0:1785945479.337567:0:9960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165141888 00000100:00100000:3.0:1785945479.337596:0:9960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1785945479.337603:0:9960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a437c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872699165141888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785945479.337628:0:9960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1785945479.337660:0:9960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a437c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872699165141888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.337687:0:9960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1785945479.337707:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785945479.337748:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a437c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872699165141888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785945479.347186:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872699165141760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9888us (10127us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.347202:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1785945479.347562:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a43577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872699165141760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785945479.354793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945479.355410:0:11094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134610176 00000100:00100000:1.0:1785945479.355420:0:11094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134610176 00000100:00100000:1.0:1785945479.355521:0:11094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 72 00000100:00100000:1.0:1785945479.355532:0:11094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+16:12151:x1872699134610176:12345-192.168.201.47@tcp:101:renameat2.0 00010000:00010000:1.0:1785945479.355556:0:11094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945479.355576:0:11094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65b600/0xf1067778b2c2bf37 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be4938489b expref: -99 pid: 11094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.355660:0:11094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65ba00/0xf1067778b2c2bf3e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.355701:0:11094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65ba00/0xf1067778b2c2bf3e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356428:0:11094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65ba00/0xf1067778b2c2bf3e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356450:0:11094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65bc00/0xf1067778b2c2bf45 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356458:0:11094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65bc00/0xf1067778b2c2bf45 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356466:0:11094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65bc00/0xf1067778b2c2bf45 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356501:0:11094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65ba00/0xf1067778b2c2bf3e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356518:0:11094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65ba00/0xf1067778b2c2bf3e lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356525:0:11094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65ba00/0xf1067778b2c2bf3e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356531:0:11094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b4a65ba00 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945479.356535:0:11094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65ba00/0xf1067778b2c2bf3e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356542:0:11094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65ba00/0xf1067778b2c2bf3e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356554:0:11094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff890b760c5c00) 00010000:00010000:1.0:1785945479.356557:0:11094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945479.356562:0:11094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65ba00/0xf1067778b2c2bf3e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356568:0:11094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65ba00/0xf1067778b2c2bf3e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356581:0:11094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65bc00/0xf1067778b2c2bf45 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356586:0:11094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65bc00/0xf1067778b2c2bf45 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356592:0:11094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65bc00/0xf1067778b2c2bf45 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356596:0:11094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b4a65bc00 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945479.356603:0:11094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65bc00/0xf1067778b2c2bf45 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356609:0:11094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65bc00/0xf1067778b2c2bf45 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356616:0:11094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0xd04803f8 (ffff890b760c5400) 00010000:00010000:1.0:1785945479.356619:0:11094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945479.356621:0:11094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65bc00/0xf1067778b2c2bf45 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356626:0:11094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65bc00/0xf1067778b2c2bf45 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356660:0:11094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65b600/0xf1067778b2c2bf37 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938489b expref: 17 pid: 11094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356773:0:11094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff890b760c5c00) 00010000:00010000:1.0:1785945479.356777:0:11094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945479.356781:0:11094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b4a65b600/0xf1067778b2c2bf37 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be4938489b expref: 17 pid: 11094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.356791:0:11094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b4a65b600, rc 0) 00000100:00100000:1.0:1785945479.356854:0:11094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+16:12151:x1872699134610176:12345-192.168.201.47@tcp:101:renameat2.0 Request processed in 1325us (2071us total) trans 0 rc 301/301 00000100:00100000:1.0:1785945479.356861:0:11094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 72 00000100:00100000:3.0:1785945479.369988:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945479.370104:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:0.0:1785945479.370301:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134610560 00000100:00100000:0.0:1785945479.370310:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134610560 00000100:00100000:0.0:1785945479.370384:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 1 00000100:00100000:0.0:1785945479.370394:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a437c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+16:12151:x1872699134610560:12345-192.168.201.47@tcp:36:renameat2.0 00000100:00100000:0.0:1785945479.370513:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a433ed500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142016:0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1785945479.370562:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945479.370609:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b44e14180 going to sleep for 11 seconds 00000100:00100000:3.0:1785945479.371796:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165142016 00000100:00100000:3.0:1785945479.371802:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165142016 00000100:00100000:3.0:1785945479.371841:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1785945479.371849:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a433eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6532:x1872699165142016:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1785945479.371944:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a433eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6532:x1872699165142016:12345-0@lo:1000:mdt_io00_001.0 Request processed in 96us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.371952:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1785945479.372098:0:6532:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967320 gen 2 00000004:00080000:0.0:1785945479.372104:0:6532:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967320 committed transno 4294967320 00000100:00100000:0.0:1785945479.372145:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a433ed500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142016:0@lo:1000:mdt_io00_001.0 00000004:00080000:0.0:1785945479.372168:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x5:0x0] 00000100:00100000:0.0:1785945479.372227:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a433ed500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142144:0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1785945479.372252:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945479.372283:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b44e14180 going to sleep for 11 seconds 00000100:00100000:3.0:1785945479.372335:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165142144 00000100:00100000:3.0:1785945479.372340:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165142144 00000100:00100000:3.0:1785945479.372379:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1785945479.372386:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a433edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6532:x1872699165142144:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1785945479.372480:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a433edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6532:x1872699165142144:12345-0@lo:1000:mdt_io00_001.0 Request processed in 95us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.372487:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1785945479.373828:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134610304 00000100:00100000:2.0:1785945479.373835:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134610304 00000100:00100000:2.0:1785945479.373884:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 9 00000100:00100000:2.0:1785945479.373891:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a437c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+14:2399:x1872699134610304:12345-192.168.201.47@tcp:103:renameat2.0 00010000:00010000:2.0:1785945479.373903:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785945479.373925:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b4d7bda00/0xf1067778b2c2bece lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be49384871 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.373942:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890b760c5300) 00010000:00010000:2.0:1785945479.373951:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785945479.373996:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a437c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+13:2399:x1872699134610304:12345-192.168.201.47@tcp:103:renameat2.0 Request processed in 105us (4017us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945479.374003:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 9 00000100:00100000:1.0:1785945479.379022:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a433ed500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142144:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1785945479.379116:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a43575500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142272:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1785945479.379185:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.379238:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a480 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.379311:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165142272 00000100:00100000:0.0:1785945479.379317:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165142272 00000100:00100000:0.0:1785945479.379375:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1785945479.379384:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a43575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6532:x1872699165142272:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1785945479.379473:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a43575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6532:x1872699165142272:12345-0@lo:1000:mdt_io00_001.0 Request processed in 89us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.379480:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1785945479.379837:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a43575500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142272:0@lo:1000:mdt_io00_001.0 00000004:00080000:1.0:1785945479.379860:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x4:0x0] 00000100:00100000:1.0:1785945479.379888:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a43575500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142400:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1785945479.379911:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.379941:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a480 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.379987:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165142400 00000100:00100000:0.0:1785945479.379992:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165142400 00000100:00100000:0.0:1785945479.380022:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1785945479.380029:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a43577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6532:x1872699165142400:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1785945479.380097:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a43577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6532:x1872699165142400:12345-0@lo:1000:mdt_io00_001.0 Request processed in 68us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.380111:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1785945479.380201:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a43575500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142400:0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1785945479.380263:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031c00/0xf1067778b2c2bf4c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.380273:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031c00/0xf1067778b2c2bf4c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.380283:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031c00/0xf1067778b2c2bf4c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785945479.380294:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a41a10000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142528:0@lo:101:mdt_io00_001.0 00000100:00100000:2.0:1785945479.380318:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.380339:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785945479.380396:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165142528 00000100:00100000:3.0:1785945479.380401:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165142528 00000100:00100000:3.0:1785945479.380433:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1785945479.380440:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a41a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6532:x1872699165142528:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:3.0:1785945479.380459:0:7466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785945479.380474:0:7466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeac00/0xf1067778b2c2bf53 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf1067778b2c2bf4c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.380498:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeac00/0xf1067778b2c2bf53 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xf1067778b2c2bf4c expref: 7 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.380512:0:7466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeac00/0xf1067778b2c2bf53 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2bf4c expref: 7 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.380520:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff890b760c5800) 00010000:00010000:3.0:1785945479.380523:0:7466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785945479.380526:0:7466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7baeac00, rc 0) 00000100:00100000:3.0:1785945479.380563:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a41a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6532:x1872699165142528:12345-0@lo:101:mdt_io00_001.0 Request processed in 124us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.380569:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1785945479.380811:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a41a10000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142528:0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1785945479.380824:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031c00/0xf1067778b2c2bf4c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2bf53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.380844:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031c00/0xf1067778b2c2bf4c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2bf53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785945479.380855:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x5:0x0] 00010000:00010000:2.0:1785945479.380872:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40030a00/0xf1067778b2c2bf5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.380878:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40030a00/0xf1067778b2c2bf5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.380885:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40030a00/0xf1067778b2c2bf5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785945479.380896:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a41a10000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142656:0@lo:101:mdt_io00_001.0 00000100:00100000:2.0:1785945479.380918:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.380943:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785945479.380989:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165142656 00000100:00100000:1.0:1785945479.380993:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165142656 00000100:00100000:1.0:1785945479.381024:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1785945479.381031:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a434df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6532:x1872699165142656:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:1.0:1785945479.381039:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945479.381051:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65b600/0xf1067778b2c2bf61 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf1067778b2c2bf5a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.381068:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65b600/0xf1067778b2c2bf61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xf1067778b2c2bf5a expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.381078:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65b600/0xf1067778b2c2bf61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2bf5a expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.381085:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x1c2f8c79 (ffff890b760c5400) 00010000:00010000:1.0:1785945479.381087:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945479.381090:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b4a65b600, rc 0) 00000100:00100000:1.0:1785945479.381131:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a434df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6532:x1872699165142656:12345-0@lo:101:mdt_io00_001.0 Request processed in 101us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945479.381136:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1785945479.381259:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a41a10000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142656:0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1785945479.381269:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40030a00/0xf1067778b2c2bf5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2bf61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.381278:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40030a00/0xf1067778b2c2bf5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2bf61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785945479.381289:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x5:0x0] 00010000:00010000:2.0:1785945479.381302:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bf68 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.381311:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bf68 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.381324:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bf68 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.381336:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031a00/0xf1067778b2c2bf6f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.381353:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031a00/0xf1067778b2c2bf6f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.381361:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031a00/0xf1067778b2c2bf6f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785945479.381393:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a434ded80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142784:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.381417:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.381438:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.381483:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165142784 00000100:00100000:0.0:1785945479.381488:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165142784 00000100:00100000:0.0:1785945479.381518:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1785945479.381525:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a41a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6532:x1872699165142784:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1785945479.381584:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a41a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6532:x1872699165142784:12345-0@lo:1000:mdt_io00_001.0 Request processed in 60us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.381590:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1785945479.381644:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a434ded80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142784:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.381701:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a434ded80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142912:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.381734:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.381751:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785945479.381841:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165142912 00000100:00100000:3.0:1785945479.381845:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165142912 00000100:00100000:3.0:1785945479.381872:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1785945479.381879:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a42ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1872699165142912:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1785945479.381936:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a42ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1872699165142912:12345-0@lo:1000:mdt_io00_001.0 Request processed in 58us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.381942:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1785945479.382029:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a434ded80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165142912:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.382060:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a42ceaa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143040:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.382082:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.382105:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785945479.382148:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165143040 00000100:00100000:3.0:1785945479.382152:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165143040 00000100:00100000:3.0:1785945479.382177:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1785945479.382183:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a434ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1872699165143040:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1785945479.382284:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a434ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1872699165143040:12345-0@lo:1000:mdt_io00_001.0 Request processed in 100us (200us total) trans 0 rc 1/1 00000100:00100000:3.0:1785945479.382291:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1785945479.382387:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a42ceaa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143040:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.382438:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a42ceaa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143168:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.382467:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.382486:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785945479.382533:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165143168 00000100:00100000:3.0:1785945479.382537:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165143168 00000100:00100000:3.0:1785945479.382565:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1785945479.382571:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b6a5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1872699165143168:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1785945479.382624:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b6a5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1872699165143168:12345-0@lo:1000:mdt_io00_001.0 Request processed in 53us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.382631:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1785945479.382754:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a42ceaa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143168:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.382798:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b6a5db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143296:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.382818:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.382843:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785945479.382950:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165143296 00000100:00100000:3.0:1785945479.382954:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165143296 00000100:00100000:3.0:1785945479.382980:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1785945479.382985:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b6a5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1872699165143296:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1785945479.383035:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b6a5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1872699165143296:12345-0@lo:1000:mdt_io00_001.0 Request processed in 49us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.383040:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1785945479.383381:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b6a5db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143296:0@lo:1000:mdt_io00_001.0 00000004:00080000:2.0:1785945479.383397:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:2.0:1785945479.383418:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b6a5db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143424:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.383438:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.383457:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785945479.383507:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165143424 00000100:00100000:1.0:1785945479.383511:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165143424 00000100:00100000:1.0:1785945479.383537:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1785945479.383544:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b6a5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6532:x1872699165143424:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1785945479.383611:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b6a5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6532:x1872699165143424:12345-0@lo:1000:mdt_io00_001.0 Request processed in 67us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945479.383617:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1785945479.383787:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b6a5db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143424:0@lo:1000:mdt_io00_001.0 00000004:00080000:2.0:1785945479.383802:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x4:0x0] 00010000:00010000:2.0:1785945479.383850:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031600/0xf1067778b2c2bf76 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.383859:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031600/0xf1067778b2c2bf76 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.383868:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031600/0xf1067778b2c2bf76 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785945479.383878:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b6a5db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143552:0@lo:101:mdt_io00_001.0 00000100:00100000:2.0:1785945479.383898:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.383923:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785945479.383980:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165143552 00000100:00100000:3.0:1785945479.383984:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165143552 00000100:00100000:3.0:1785945479.384007:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1785945479.384013:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b6a5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1872699165143552:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:3.0:1785945479.384021:0:7466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785945479.384034:0:7466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeba00/0xf1067778b2c2bf7d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf1067778b2c2bf76 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.384055:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeba00/0xf1067778b2c2bf7d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xf1067778b2c2bf76 expref: 9 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.384081:0:7466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeba00/0xf1067778b2c2bf7d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2bf76 expref: 9 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.384090:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890a433b4e00) 00010000:00010000:3.0:1785945479.384093:0:7466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1785945479.384096:0:7466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b7baeba00, rc 0) 00000100:00100000:3.0:1785945479.384122:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b6a5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6532:x1872699165143552:12345-0@lo:101:mdt_io00_001.0 Request processed in 109us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.384127:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1785945479.384209:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b6a5db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143552:0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1785945479.384221:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031600/0xf1067778b2c2bf76 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2bf7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.384235:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031600/0xf1067778b2c2bf76 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2bf7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785945479.384246:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x6:0x0] 00010000:00010000:2.0:1785945479.384269:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b4d7bc200/0xf1067778b2c2bf84 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.384275:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b4d7bc200/0xf1067778b2c2bf84 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x2 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.384282:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b4d7bc200/0xf1067778b2c2bf84 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x2 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785945479.384292:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b6a5db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143680:0@lo:101:mdt_io00_001.0 00000100:00100000:2.0:1785945479.384311:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.384331:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785945479.384395:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165143680 00000100:00100000:1.0:1785945479.384399:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165143680 00000100:00100000:1.0:1785945479.384477:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1785945479.384484:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b6a5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6532:x1872699165143680:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:1.0:1785945479.384492:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945479.384503:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65bc00/0xf1067778b2c2bf8b lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf1067778b2c2bf84 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.384517:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65bc00/0xf1067778b2c2bf8b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xf1067778b2c2bf84 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.384526:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65bc00/0xf1067778b2c2bf8b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2bf84 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.384533:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff890b760c5e00) 00010000:00010000:1.0:1785945479.384536:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945479.384538:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b4a65bc00, rc 0) 00000100:00100000:1.0:1785945479.384576:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b6a5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6532:x1872699165143680:12345-0@lo:101:mdt_io00_001.0 Request processed in 92us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945479.384582:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1785945479.384622:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b6a5db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143680:0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1785945479.384631:0:6532:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b4d7bc200/0xf1067778b2c2bf84 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2bf8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.384639:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b4d7bc200/0xf1067778b2c2bf84 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2bf8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.384647:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b4d7bc200/0xf1067778b2c2bf84 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2bf8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785945479.384720:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b6a5db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143808:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.384749:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.399663:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.400814:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165143808 00000100:00100000:0.0:1785945479.400825:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165143808 00000100:00100000:0.0:1785945479.400882:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1785945479.400892:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a42ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6532:x1872699165143808:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1785945479.401007:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a42ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6532:x1872699165143808:12345-0@lo:1000:mdt_io00_001.0 Request processed in 116us (16256us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.401015:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1785945479.403882:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b6a5db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143808:0@lo:1000:mdt_io00_001.0 00000004:00080000:2.0:1785945479.403931:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:2.0:1785945479.403990:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b6a5db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143936:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.404046:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.404096:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.404174:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165143936 00000100:00100000:0.0:1785945479.404180:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165143936 00000100:00100000:0.0:1785945479.404212:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1785945479.404220:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a42cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6532:x1872699165143936:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1785945479.404300:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a42cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6532:x1872699165143936:12345-0@lo:1000:mdt_io00_001.0 Request processed in 81us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.404308:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1785945479.404379:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b6a5db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165143936:0@lo:1000:mdt_io00_001.0 00000004:00080000:2.0:1785945479.404394:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x4:0x0] 00000100:00100000:2.0:1785945479.404421:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b6a5db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165144064:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.404442:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.404463:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785945479.406828:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165144064 00000100:00100000:3.0:1785945479.406839:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165144064 00000100:00100000:3.0:1785945479.406888:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1785945479.406897:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6532:x1872699165144064:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1785945479.407007:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6532:x1872699165144064:12345-0@lo:1000:mdt_io00_001.0 Request processed in 111us (2564us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.407014:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1785945479.407169:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b6a5db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165144064:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.407246:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a436aed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165144192:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.407274:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.407310:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b711b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785945479.407367:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165144192 00000100:00100000:3.0:1785945479.407371:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165144192 00000100:00100000:3.0:1785945479.407399:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1785945479.407405:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6532:x1872699165144192:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1785945479.407472:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6532:x1872699165144192:12345-0@lo:1000:mdt_io00_001.0 Request processed in 67us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.407479:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1785945479.407538:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a436aed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165144192:0@lo:1000:mdt_io00_001.0 00000040:00080000:2.0:1785945479.407833:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].2, 560 off34408 00000100:00100000:2.0:1785945479.407883:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a436aed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165144320:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1785945479.407910:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785945479.407922:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b4dc96b40 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.408028:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165144320 00000100:00100000:0.0:1785945479.408032:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165144320 00000100:00100000:0.0:1785945479.408053:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1785945479.408060:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6532:x1872699165144320:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1785945479.408135:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6532:x1872699165144320:12345-0@lo:1000:mdt_io00_001.0 Request processed in 75us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.408141:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1785945479.409477:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a436aed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6532:1872699165144320:0@lo:1000:mdt_io00_001.0 00000040:00080000:2.0:1785945479.409514:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].2, 640 off34632 00000004:00080000:2.0:1785945479.409522:0:6532:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff890b711b49c0 with version 5 00000004:00080000:3.0:1785945479.409585:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff890b750c36c0 version 5 rpc_version 5 00000020:00100000:3.0:1785945479.409608:0:7464:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785945479.409615:0:7464:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff890a437c7480 x1872699165144576/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1712/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785945479.409640:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a437c7480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1872699165144576:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785945479.409706:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785945479.409742:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff890a4369b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785945479.409843:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165144576 00000100:00100000:0.0:1785945479.409848:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165144576 00000100:00100000:0.0:1785945479.409885:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1785945479.409893:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a437c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7464:x1872699165144576:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785945479.410142:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a437c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:7464:x1872699165144576:12345-0@lo:1000:osp_up0-1.0 Request processed in 249us (435us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1785945479.410149:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1785945479.410239:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a437c7480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1872699165144576:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1785945479.410323:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x6:0x0] 00010000:00010000:0.0:1785945479.410332:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031600/0xf1067778b2c2bf76 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2bf7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410353:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031600/0xf1067778b2c2bf76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2bf7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410365:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bf68 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410372:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bf68 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410379:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bf68 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410385:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b40031000 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:0.0:1785945479.410390:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bf68 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410408:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bf68 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410423:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff890b760c5c00) 00010000:00010000:0.0:1785945479.410426:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785945479.410430:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bf68 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410436:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bf68 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785945479.410449:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ce08ae2 reply state 00000000f6cffe18 transno 4294967315 ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031a00/0xf1067778b2c2bf6f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410461:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031a00/0xf1067778b2c2bf6f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410468:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0xd04803f8 (ffff890a42d7c600) 00010000:00010000:0.0:1785945479.410470:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785945479.410472:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00080000:0.0:1785945479.410476:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x5:0x0] 00010000:00010000:0.0:1785945479.410481:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031c00/0xf1067778b2c2bf4c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2bf53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410488:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031c00/0xf1067778b2c2bf4c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xf1067778b2c2bf53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410494:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031c00/0xf1067778b2c2bf4c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xf1067778b2c2bf53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410527:0:6532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785945479.410532:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x5:0x0] 00010000:00010000:0.0:1785945479.410537:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40030a00/0xf1067778b2c2bf5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2bf61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410544:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40030a00/0xf1067778b2c2bf5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xf1067778b2c2bf61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410552:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b4d7bc200/0xf1067778b2c2bf84 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xf1067778b2c2bf8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410559:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b4d7bc200/0xf1067778b2c2bf84 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xf1067778b2c2bf8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410565:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b4d7bc200/0xf1067778b2c2bf84 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xf1067778b2c2bf8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410578:0:6532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1785945479.410606:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785945479.410611:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031c00/0xf1067778b2c2bf4c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xf1067778b2c2bf53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410617:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b40031c00 already unused, calling callback (ffffffffc1762ee0) 00010000:00010000:0.0:1785945479.410621:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031c00/0xf1067778b2c2bf4c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xf1067778b2c2bf53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785945479.410628:0:9525:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031c00/0xf1067778b2c2bf4c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xf1067778b2c2bf53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410656:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031c00/0xf1067778b2c2bf4c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2bf53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410662:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785945479.410780:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031c00/0xf1067778b2c2bf4c lrc: 1/0,0 mode: --/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2bf53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410788:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40031c00/0xf1067778b2c2bf4c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2bf53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410805:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785945479.410808:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b4d7bc200/0xf1067778b2c2bf84 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xf1067778b2c2bf8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410814:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b4d7bc200 already unused, calling callback (ffffffffc1762ee0) 00010000:00010000:0.0:1785945479.410818:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b4d7bc200/0xf1067778b2c2bf84 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xf1067778b2c2bf8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785945479.410825:0:9525:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b4d7bc200/0xf1067778b2c2bf84 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xf1067778b2c2bf8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410841:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b4d7bc200/0xf1067778b2c2bf84 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2bf8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410846:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785945479.410861:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b4d7bc200/0xf1067778b2c2bf84 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2bf8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410878:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b4d7bc200/0xf1067778b2c2bf84 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xf1067778b2c2bf8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.410890:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785945479.410892:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785945479.410894:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785945479.410906:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a433ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872699165144704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785945479.410939:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945479.410979:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a434a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872699165144832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785945479.411006:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945479.411033:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165144704 00000100:00100000:0.0:1785945479.411037:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165144704 00000100:00100000:0.0:1785945479.411066:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165144832 00000100:00100000:0.0:1785945479.411069:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165144832 00000100:00100000:0.0:1785945479.411088:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1785945479.411094:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a42f28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3647:x1872699165144704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785945479.411105:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785945479.411121:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b7baeac00/0xf1067778b2c2bf53 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xf1067778b2c2bf4c expref: 12 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.411131:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff890b760c5800) 00010000:00010000:0.0:1785945479.411134:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785945479.411163:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a42f28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3647:x1872699165144704:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.411170:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1785945479.411182:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1785945479.411195:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b4707d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3644:x1872699165144832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785945479.411204:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785945479.411215:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65bc00/0xf1067778b2c2bf8b lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xf1067778b2c2bf84 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785945479.411226:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff890b760c5e00) 00010000:00010000:0.0:1785945479.411232:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785945479.411258:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b4707d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3644:x1872699165144832:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.411264:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1785945479.411316:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a433ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872699165144704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785945479.411352:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a434a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872699165144832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785945479.411409:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a437c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+18:12151:x1872699134610560:12345-192.168.201.47@tcp:36:renameat2.0 Request processed in 41016us (41303us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1785945479.411416:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 1 00010000:00010000:2.0:1785945479.411652:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785945479.461282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945479.461456:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134610688 00000100:00100000:3.0:1785945479.461477:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134610688 00000100:00100000:3.0:1785945479.461534:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 73 00000100:00100000:3.0:1785945479.461544:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a436aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+18:12152:x1872699134610688:12345-192.168.201.47@tcp:101:lfs.0 00010000:00010000:3.0:1785945479.461569:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785945479.461589:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baeac00/0xf1067778b2c2bf92 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be493848a2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.461652:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baeae00/0xf1067778b2c2bf99 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.461685:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baeae00/0xf1067778b2c2bf99 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.461698:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baeae00/0xf1067778b2c2bf99 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.461711:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031c00/0xf1067778b2c2bfa0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.461719:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031c00/0xf1067778b2c2bfa0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.461725:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031c00/0xf1067778b2c2bfa0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.461785:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bfa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.461806:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.461814:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785945479.461835:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.461848:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baeae00/0xf1067778b2c2bf99 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.461855:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baeae00/0xf1067778b2c2bf99 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.461966:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baeae00/0xf1067778b2c2bf99 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.461972:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baeae00/0xf1067778b2c2bf99 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.461977:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b7baeae00 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:3.0:1785945479.461982:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baeae00/0xf1067778b2c2bf99 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.461990:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baeae00/0xf1067778b2c2bf99 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.462002:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff890b760c5c00) 00010000:00010000:3.0:1785945479.462004:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785945479.462009:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baeae00/0xf1067778b2c2bf99 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.462022:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baeae00/0xf1067778b2c2bf99 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.462037:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031c00/0xf1067778b2c2bfa0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.462043:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031c00/0xf1067778b2c2bfa0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.462049:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031c00/0xf1067778b2c2bfa0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.462054:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b40031c00 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:3.0:1785945479.462057:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031c00/0xf1067778b2c2bfa0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.462063:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031c00/0xf1067778b2c2bfa0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.462071:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0xd04803f8 (ffff890a42d7c600) 00010000:00010000:3.0:1785945479.462074:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785945479.462077:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031c00/0xf1067778b2c2bfa0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.462083:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031c00/0xf1067778b2c2bfa0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.462109:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff890b7baeac00/0xf1067778b2c2bf92 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be493848a2 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.462120:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff890b40031000/0xf1067778b2c2bfa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be493848a2 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.462133:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890a433b4800) 00010000:00010000:3.0:1785945479.462135:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785945479.462137:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b40031000, rc 0) 00000100:00100000:3.0:1785945479.462199:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a436aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+19:12152:x1872699134610688:12345-192.168.201.47@tcp:101:lfs.0 Request processed in 656us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.462207:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 73 00000100:00100000:2.0:1785945479.472117:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945479.472204:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134610816 00000100:00100000:1.0:1785945479.472226:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134610816 00000100:00100000:1.0:1785945479.472281:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 74 00000100:00100000:1.0:1785945479.472290:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b6a5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+13:12152:x1872699134610816:12345-192.168.201.47@tcp:101:lfs.0 00010000:00010000:1.0:1785945479.472310:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945479.472329:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65ba00/0xf1067778b2c2bfae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be493848a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.472396:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65a000/0xf1067778b2c2bfb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.472411:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65a000/0xf1067778b2c2bfb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.472421:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65a000/0xf1067778b2c2bfb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785945479.472477:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x6:0x0]: returning size 4 00000004:00200000:1.0:1785945479.472482:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1785945479.472513:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65ba00/0xf1067778b2c2bfae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be493848a9 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.472529:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65a000/0xf1067778b2c2bfb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be493848a9 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.472537:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890a433b4e00) 00010000:00010000:1.0:1785945479.472540:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785945479.472543:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b4a65a000, rc 0) 00000100:00100000:1.0:1785945479.472600:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b6a5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+14:12152:x1872699134610816:12345-192.168.201.47@tcp:101:lfs.0 Request processed in 310us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945479.472606:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 74 00000100:00100000:2.0:1785945479.492548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945479.492656:0:11094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134610944 00000100:00100000:1.0:1785945479.492698:0:11094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134610944 00000100:00100000:1.0:1785945479.492759:0:11094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 75 00000100:00100000:1.0:1785945479.492769:0:11094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a4368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+14:11987:x1872699134610944:12345-192.168.201.47@tcp:101:bash.0 00010000:00010000:1.0:1785945479.492790:0:11094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785945479.492812:0:11094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65ba00/0xf1067778b2c2bfbc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x47a2a1be493848b0 expref: -99 pid: 11094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.492874:0:11094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65ae00/0xf1067778b2c2bfc3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.492887:0:11094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65ae00/0xf1067778b2c2bfc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.492898:0:11094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65ae00/0xf1067778b2c2bfc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.492908:0:11094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65aa00/0xf1067778b2c2bfca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.492918:0:11094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65b600/0xf1067778b2c2bf61 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xf1067778b2c2bf5a expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.492927:0:11094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65aa00/0xf1067778b2c2bfca lrc: 4/1,0 mode: --/PR res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.492956:0:11094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65b600/0xf1067778b2c2bf61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xf1067778b2c2bf5a expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785945479.492971:0:11094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a43575500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11094:1872699165144960:0@lo:104: 00000100:00100000:1.0:1785945479.493032:0:11094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945479.493105:0:11094:0:(client.c:2702:ptlrpc_set_wait()) set ffff890b5004a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785945479.493167:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1785945479.493178:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165144960 00000100:00100000:2.0:1785945479.493181:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165144960 00000100:00100000:2.0:1785945479.493205:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1785945479.493211:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a43690c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:11094:x1872699165144960:12345-0@lo:104: 00010000:00010000:2.0:1785945479.493224:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40030a00/0xf1067778b2c2bf5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xf1067778b2c2bf61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785945479.493287:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785945479.493293:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a43690c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:11094:x1872699165144960:12345-0@lo:104: Request processed in 82us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945479.493300:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1785945479.493383:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785945479.493389:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40030a00/0xf1067778b2c2bf5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xf1067778b2c2bf61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.493397:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b40030a00 already unused, calling callback (ffffffffc1762ee0) 00000100:00100000:1.0:1785945479.493399:0:11094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a43575500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11094:1872699165144960:0@lo:104: 00010000:00010000:3.0:1785945479.493402:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40030a00/0xf1067778b2c2bf5a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xf1067778b2c2bf61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785945479.493410:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40030a00/0xf1067778b2c2bf5a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xf1067778b2c2bf61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.493414:0:11094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65aa00/0xf1067778b2c2bfca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.493433:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40030a00/0xf1067778b2c2bf5a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xf1067778b2c2bf61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.493441:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785945479.493474:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40030a00/0xf1067778b2c2bf5a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xf1067778b2c2bf61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.493481:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff890b40030a00/0xf1067778b2c2bf5a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xf1067778b2c2bf61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.493510:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785945479.493511:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785945479.493513:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785945479.494432:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785945479.494446:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a437c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872699165145088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785945479.494492:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785945479.494570:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165145088 00000100:00100000:3.0:1785945479.494575:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165145088 00010000:00010000:3.0:1785945479.494596:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65b600/0xf1067778b2c2bf61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xf1067778b2c2bf5a expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785945479.494627:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1785945479.494634:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a43575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3644:x1872699165145088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785945479.494644:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1785945479.496320:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967323 is committed 00010000:00010000:3.0:1785945479.497157:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65b600/0xf1067778b2c2bf61 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xf1067778b2c2bf5a expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.497176:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x1c2f8c79 (ffff890b760c5400) 00010000:00010000:3.0:1785945479.497182:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65aa00/0xf1067778b2c2bfca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.497193:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65aa00/0xf1067778b2c2bfca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.497201:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65aa00/0xf1067778b2c2bfca lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785945479.497230:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785945479.497295:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a43575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3644:x1872699165145088:12345-0@lo:103:ldlm_bl.0 Request processed in 2661us (2801us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945479.497304:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:1.0:1785945479.497385:0:11094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65aa00/0xf1067778b2c2bfca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497393:0:11094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65aa00/0xf1067778b2c2bfca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497437:0:11094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65ae00/0xf1067778b2c2bfc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497444:0:11094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65ae00/0xf1067778b2c2bfc3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497450:0:11094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65ae00/0xf1067778b2c2bfc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497457:0:11094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b4a65ae00 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945479.497460:0:11094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65ae00/0xf1067778b2c2bfc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497479:0:11094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65ae00/0xf1067778b2c2bfc3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497498:0:11094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff890b760c5800) 00010000:00010000:1.0:1785945479.497501:0:11094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945479.497504:0:11094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65ae00/0xf1067778b2c2bfc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497509:0:11094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65ae00/0xf1067778b2c2bfc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497518:0:11094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65aa00/0xf1067778b2c2bfca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497524:0:11094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65aa00/0xf1067778b2c2bfca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497530:0:11094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65aa00/0xf1067778b2c2bfca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497536:0:11094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890b4a65aa00 already unused, calling callback (ffffffffc17564f0) 00010000:00010000:1.0:1785945479.497538:0:11094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65aa00/0xf1067778b2c2bfca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497544:0:11094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65aa00/0xf1067778b2c2bfca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497550:0:11094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x1c2f8c79 (ffff890b760c5400) 00010000:00010000:1.0:1785945479.497552:0:11094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945479.497554:0:11094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65aa00/0xf1067778b2c2bfca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497559:0:11094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65aa00/0xf1067778b2c2bfca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497609:0:11094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65ba00/0xf1067778b2c2bfbc lrc: 1/0,0 mode: --/CR res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be493848b0 expref: 15 pid: 11094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497619:0:11094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff890b760c5800) 00010000:00010000:1.0:1785945479.497622:0:11094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785945479.497625:0:11094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890b4a65ba00/0xf1067778b2c2bfbc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.47@tcp remote: 0x47a2a1be493848b0 expref: 15 pid: 11094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785945479.497633:0:11094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890b4a65ba00, rc 0) 00000100:00100000:1.0:1785945479.497717:0:11094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a4368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+14:11987:x1872699134610944:12345-192.168.201.47@tcp:101:bash.0 Request processed in 4940us (5167us total) trans 0 rc 301/301 00000100:00100000:1.0:1785945479.497724:0:11094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 75 00000100:00100000:0.0:1785945479.498171:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a437c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872699165145088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785945479.856346:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785945479.856373:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a42f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872699165145216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785945479.856446:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945479.856664:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165145216 00000100:00100000:0.0:1785945479.856697:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165145216 00000100:00100000:0.0:1785945479.856756:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1785945479.856766:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a4368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1872699165145216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1785945479.856802:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1785945479.856868:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a4368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1872699165145216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945479.856875:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1785945479.857245:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a42f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872699165145216:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1785945480.232834:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785945480.957481:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945480.957515:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945480.957614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945480.957645:0:9395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134611584 00000100:00100000:3.0:1785945480.957654:0:9395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134611584 00000100:00100000:3.0:1785945480.957744:0:9395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 124 00000100:00100000:3.0:1785945480.957753:0:9395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a437c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+6:2401:x1872699134611584:12345-192.168.201.47@tcp:400:kworker.0 00000100:00100000:3.0:1785945480.957816:0:9395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a437c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+6:2401:x1872699134611584:12345-192.168.201.47@tcp:400:kworker.0 Request processed in 65us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945480.957823:0:9395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 124 00000100:00080000:3.0:1785945480.957841:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785945480.960971:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134611072 00000100:00100000:1.0:1785945480.960985:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134611072 00000100:00100000:1.0:1785945480.961035:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 358 00000100:00100000:1.0:1785945480.961046:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b464ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5045a659-c567-4cac-bdde-f6c848dd97e5+10:2401:x1872699134611072:12345-192.168.201.47@tcp:400:kworker.0 00000100:00100000:1.0:1785945480.961113:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b464ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5045a659-c567-4cac-bdde-f6c848dd97e5+10:2401:x1872699134611072:12345-192.168.201.47@tcp:400:kworker.0 Request processed in 69us (3640us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945480.961120:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 358 00000100:00100000:0.0:1785945480.961328:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134611328 00000100:00100000:0.0:1785945480.961333:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134611328 00000100:00100000:0.0:1785945480.961385:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 328 00000100:00100000:0.0:1785945480.961393:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a437c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+19:2401:x1872699134611328:12345-192.168.201.47@tcp:400:kworker.0 00000100:00100000:0.0:1785945480.961434:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a437c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+19:2401:x1872699134611328:12345-192.168.201.47@tcp:400:kworker.0 Request processed in 43us (3918us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945480.961441:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 328 00000100:00080000:3.0:1785945480.961525:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785945480.979061:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945480.979098:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:3.0:1785945480.979124:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134611200 00000100:00100000:3.0:1785945480.979133:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134611200 00000100:00100000:3.0:1785945480.979180:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 329 00000100:00100000:3.0:1785945480.979190:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a437c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+14:2401:x1872699134611200:12345-192.168.201.47@tcp:400:kworker.0 00000100:00100000:3.0:1785945480.979257:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a437c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+14:2401:x1872699134611200:12345-192.168.201.47@tcp:400:kworker.0 Request processed in 68us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945480.979265:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 329 00000100:00100000:3.0:1785945480.979288:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134611456 00000100:00100000:3.0:1785945480.979291:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134611456 00000100:00100000:3.0:1785945480.979331:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 125 00000100:00100000:3.0:1785945480.979339:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a437c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:2401:x1872699134611456:12345-192.168.201.47@tcp:400:kworker.0 00000100:00100000:3.0:1785945480.979378:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a437c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:2401:x1872699134611456:12345-192.168.201.47@tcp:400:kworker.0 Request processed in 39us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945480.979385:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 125 00000100:00080000:3.0:1785945480.979793:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785945481.264967:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785945481.548299:0:14233:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_24Kb: @@@@@@ FAIL: test_24Kb failed with 1 00010000:00010000:3.0:1785945482.284545:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785945482.499757:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:0.0:1785945482.499794:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:1.0:1785945482.499886:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134611712 00000100:00100000:1.0:1785945482.499895:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134611712 00002000:00100000:1.0:1785945482.499958:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x2:0x0] (0->3) req@ffff890a42f29500 x1872699134611712/t0(0) o4->c6c4f589-e21c-4e62-92ab-2e9f8ed83de9@192.168.201.47@tcp:543/0 lens 496/0 e 0 to 0 dl 1785945493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785945482.499968:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890a42f29500 with x1872699134611712 ext(0->3) 00002000:00010000:1.0:1785945482.499986:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff890a42f29500 00000100:00100000:1.0:1785945482.500020:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 2 00000100:00100000:1.0:1785945482.500031:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a42f29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:2400:x1872699134611712:12345-192.168.201.47@tcp:4:bash.0 00000100:00080000:0.0:1785945482.500576:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785945482.500631:0:9395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134611840 00000100:00100000:3.0:1785945482.500637:0:9395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134611840 00000100:00100000:3.0:1785945482.500697:0:9395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 30 00000100:00100000:3.0:1785945482.500706:0:9395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a42f28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+11:2400:x1872699134611840:12345-192.168.201.47@tcp:16:kworker.0 00000100:00100000:1.0:1785945482.503044:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a42f29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+11:2400:x1872699134611712:12345-192.168.201.47@tcp:4:bash.0 Request processed in 3007us (3286us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1785945482.503057:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 2 00002000:00100000:1.0:1785945482.503068:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x2:0x0] (0->3) req@ffff890a42f29500 x1872699134611712/t4294967301(0) o4->c6c4f589-e21c-4e62-92ab-2e9f8ed83de9@192.168.201.47@tcp:543/0 lens 496/448 e 0 to 0 dl 1785945493 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785945482.503078:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890a42f29500 with x1872699134611712 ext(0->3) 00002000:00010000:1.0:1785945482.503084:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff890a42f29500 00000001:00080000:0.0:1785945482.504558:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1785945482.504727:0:9395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a42f28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+8:2400:x1872699134611840:12345-192.168.201.47@tcp:16:kworker.0 Request processed in 4019us (4927us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945482.504736:0:9395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 30 00000100:00100000:0.0:1785945482.536363:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:0.0:1785945482.536413:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.47@tcp (source: 12345-192.168.201.47@tcp) 00000100:00100000:2.0:1785945482.536441:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134611968 00000100:00100000:2.0:1785945482.536451:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134611968 00000100:00100000:1.0:1785945482.536488:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699134612096 00000100:00100000:1.0:1785945482.536492:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699134612096 00002000:00100000:2.0:1785945482.536503:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->3) req@ffff890a41a16300 x1872699134611968/t0(0) o4->c6c4f589-e21c-4e62-92ab-2e9f8ed83de9@192.168.201.47@tcp:543/0 lens 496/0 e 0 to 0 dl 1785945493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785945482.536513:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890a41a16300 with x1872699134611968 ext(0->3) 00002000:00010000:2.0:1785945482.536518:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff890a41a16300 00000100:00100000:1.0:1785945482.536534:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 31 00000100:00100000:2.0:1785945482.536542:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.47@tcp, seq: 3 00000100:00100000:1.0:1785945482.536543:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a433ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+9:2401:x1872699134612096:12345-192.168.201.47@tcp:16:kworker.0 00000100:00100000:2.0:1785945482.536562:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a41a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+9:2401:x1872699134611968:12345-192.168.201.47@tcp:4:bash.0 00000100:00100000:1.0:1785945482.536635:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a433ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+9:2401:x1872699134612096:12345-192.168.201.47@tcp:16:kworker.0 Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945482.536641:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 31 00000100:00100000:2.0:1785945482.537467:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a41a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c6c4f589-e21c-4e62-92ab-2e9f8ed83de9+10:2401:x1872699134611968:12345-192.168.201.47@tcp:4:bash.0 Request processed in 898us (1045us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1785945482.537474:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.47@tcp, seq: 3 00002000:00100000:2.0:1785945482.537481:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->3) req@ffff890a41a16300 x1872699134611968/t4294967302(0) o4->c6c4f589-e21c-4e62-92ab-2e9f8ed83de9@192.168.201.47@tcp:543/0 lens 496/448 e 0 to 0 dl 1785945493 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785945482.537492:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890a41a16300 with x1872699134611968 ext(0->3) 00002000:00010000:2.0:1785945482.537495:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff890a41a16300 00000100:00100000:0.0:1785945482.921314:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785945482.921337:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a437c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872699165145344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785945482.921415:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785945482.921523:0:9960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165145344 00000100:00100000:3.0:1785945482.921531:0:9960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165145344 00000100:00100000:3.0:1785945482.921587:0:9960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1785945482.921597:0:9960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a434a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872699165145344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785945482.921624:0:9960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1785945482.921694:0:9960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a434a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872699165145344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945482.921702:0:9960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1785945482.921747:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a437c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872699165145344:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1785945482.921828:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785945482.922446:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785945482.922457:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a437c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872699165145472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785945482.922489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785945482.922559:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165145472 00000100:00100000:3.0:1785945482.922564:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165145472 00000100:00100000:3.0:1785945482.922609:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1785945482.922616:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a4368d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872699165145472:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1785945482.922623:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1785945482.922642:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1785945482.922706:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a4368d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872699165145472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945482.922712:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1785945482.922718:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a437c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872699165145472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785945482.934857:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872699165145856:0@lo:400:kworker.0 00000100:00100000:0.0:1785945482.934940:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945482.934947:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7a4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1872699165145984:0@lo:400:kworker.0 00000100:00100000:1.0:1785945482.934976:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945482.934984:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872699165146368:0@lo:400:kworker.0 00000100:00100000:0.0:1785945482.935004:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945482.935011:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872699165146496:0@lo:400:kworker.0 00000100:00100000:0.0:1785945482.935021:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872699165146880:0@lo:400:kworker.0 00000100:00100000:1.0:1785945482.935034:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945482.935039:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945482.935059:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1785945482.935059:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1785945482.935064:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890a434a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d82a3e60-742f-488f-987a-c5d63577fef1:3644:1872699165145600:0@lo:400:kworker.0 00000100:00100000:0.0:1785945482.935077:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872699165145728:0@lo:400:kworker.0 00000100:00100000:1.0:1785945482.935088:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945482.935098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945482.935117:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872699165146240:0@lo:400:kworker.0 00000100:00100000:1.0:1785945482.935118:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165146112:0@lo:400:kworker.0 00000100:00100000:1.0:1785945482.935137:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945482.935137:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945482.935151:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f4a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165146624:0@lo:400:kworker.0 00000100:00100000:0.0:1785945482.935151:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff890b7f4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872699165146752:0@lo:400:kworker.0 00000100:00100000:1.0:1785945482.935169:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785945482.935171:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785945482.935193:0:11094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165145984 00000100:00100000:0.0:1785945482.935193:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165145856 00000100:00100000:0.0:1785945482.935199:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165145856 00000100:00100000:1.0:1785945482.935200:0:11094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165145984 00000100:00100000:1.0:1785945482.935231:0:11094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165146368 00000100:00100000:1.0:1785945482.935234:0:11094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165146368 00000100:00100000:0.0:1785945482.935235:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165146112 00000100:00100000:0.0:1785945482.935237:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165146112 00000100:00100000:1.0:1785945482.935251:0:11094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165146880 00000100:00100000:1.0:1785945482.935253:0:11094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165146880 00000100:00100000:0.0:1785945482.935253:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1785945482.935260:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3647:x1872699165145856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785945482.935264:0:11094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165145728 00000100:00100000:1.0:1785945482.935265:0:11094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165145728 00000100:00100000:1.0:1785945482.935274:0:11094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165146240 00000100:00100000:1.0:1785945482.935276:0:11094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165146240 00000100:00100000:1.0:1785945482.935322:0:11094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165146752 00000100:00100000:1.0:1785945482.935325:0:11094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165146752 00000100:00100000:0.0:1785945482.935330:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3647:x1872699165145856:12345-0@lo:400:kworker.0 Request processed in 70us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945482.935337:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1785945482.935339:0:11094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1785945482.935344:0:11094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a43577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1872699165145984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785945482.935353:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1785945482.935358:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a4352ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1872699165146112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785945482.935422:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165146496 00000100:00100000:2.0:1785945482.935427:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165146496 00000100:00100000:2.0:1785945482.935454:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165146624 00000100:00100000:2.0:1785945482.935457:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165146624 00000100:00100000:2.0:1785945482.935477:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1785945482.935483:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a4352e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1872699165146496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785945482.935545:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1785945482.935554:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872699165146368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785945482.936592:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a4352ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1872699165146112:12345-0@lo:400:kworker.0 Request processed in 1230us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945482.936601:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1785945482.936627:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1785945482.936635:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872699165146880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785945482.936686:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872699165146880:12345-0@lo:400:kworker.0 Request processed in 53us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945482.936692:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1785945482.936705:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1785945482.936720:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872699165145728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785945482.936747:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872699165145728:12345-0@lo:400:kworker.0 Request processed in 29us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945482.936753:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1785945482.936762:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1785945482.936767:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b7f4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872699165146240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785945482.936787:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872699165146240:12345-0@lo:400:kworker.0 Request processed in 19us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945482.936792:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1785945482.936801:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1785945482.936806:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a43483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872699165146752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785945482.936825:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a43483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872699165146752:12345-0@lo:400:kworker.0 Request processed in 19us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1785945482.936831:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:0.0:1785945482.936852:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785945482.936856:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785945482.936858:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1785945482.937625:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872699165145728:0@lo:400:kworker.0 00000100:00100000:0.0:1785945482.937636:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872699165146240:0@lo:400:kworker.0 00000100:00100000:0.0:1785945482.937646:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872699165146752:0@lo:400:kworker.0 00000100:00100000:0.0:1785945482.937656:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1785945482.937662:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:1.0:1785945482.937896:0:11094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a43577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1872699165145984:12345-0@lo:400:kworker.0 Request processed in 2549us (2917us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945482.937904:0:11094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1785945482.937931:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872699165145600 00000100:00100000:1.0:1785945482.937937:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872699165145600 00000100:00100000:1.0:1785945482.937968:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1785945482.937968:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872699165145856:0@lo:400:kworker.0 00000100:00100000:1.0:1785945482.937974:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890b464b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d82a3e60-742f-488f-987a-c5d63577fef1+24:3644:x1872699165145600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785945482.937983:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872699165146880:0@lo:400:kworker.0 00000100:00100000:1.0:1785945482.938020:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b464b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d82a3e60-742f-488f-987a-c5d63577fef1+24:3644:x1872699165145600:12345-0@lo:400:kworker.0 Request processed in 46us (2930us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945482.938026:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1785945482.938061:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890a434a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d82a3e60-742f-488f-987a-c5d63577fef1:3644:1872699165145600:0@lo:400:kworker.0 00000100:00100000:1.0:1785945482.938081:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165146112:0@lo:400:kworker.0 00000100:00100000:1.0:1785945482.938091:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7a4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1872699165145984:0@lo:400:kworker.0 00000100:00100000:1.0:1785945482.938136:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1785945482.938144:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890a4352ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1872699165146624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785945482.938182:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a4352ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1872699165146624:12345-0@lo:400:kworker.0 Request processed in 40us (3011us total) trans 0 rc 0/0 00000100:00100000:1.0:1785945482.938188:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1785945482.938216:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f4a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872699165146624:0@lo:400:kworker.0 00000100:00100000:2.0:1785945482.948001:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890a4352e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1872699165146496:12345-0@lo:400:kworker.0 Request processed in 12509us (12957us total) trans 0 rc 0/0 00000100:00100000:2.0:1785945482.948016:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1785945482.950034:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872699165146496:0@lo:400:kworker.0 00000100:00100000:3.0:1785945482.959470:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890b7f4a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872699165146368:12345-0@lo:400:kworker.0 Request processed in 23908us (24454us total) trans 0 rc 0/0 00000100:00100000:3.0:1785945482.959485:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1785945482.959741:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff890b7f403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872699165146368:0@lo:400:kworker.0 00010000:00010000:0.0:1785945483.305778:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 2558 lines, 2558 kept, 0 dropped, 0 bad.