00000100:00100000:0.0F:1787096282.096534:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084469248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787096282.096625:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0F:1787096282.096703:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084469248 00000100:00100000:3.0:1787096282.096723:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084469248 00000100:00100000:3.0:1787096282.096794:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787096282.096807:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a87946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084469248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787096282.096859:0:7980:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446375424 avail 1300135936 00000100:00100000:3.0:1787096282.096927:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a87946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084469248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096282.096935:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787096282.096985:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084469248:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0F:1787096282.098732:0:7389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762c00/0x9eebb2eb7f50d986 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50d98d expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096282.098758:0:7389:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762c00/0x9eebb2eb7f50d986 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50d98d expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.098765:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d68b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.098778:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d68b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.098787:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d68b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.098794:0:7389:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762c00/0x9eebb2eb7f50d986 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d98d expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.098795:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983881a00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096282.098803:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d68b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.098808:0:7389:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096282.098816:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d68b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.098834:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8c7a8b27af00) 00010000:00010000:2.0:1787096282.098834:0:7389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762c00/0x9eebb2eb7f50d986 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d98d expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.098841:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096282.098850:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d68b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.098858:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d68b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.098864:0:7389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8000/0x9eebb2eb7f50d7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50d7cd expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096282.098875:0:7389:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8000/0x9eebb2eb7f50d7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50d7cd expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.098882:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d692 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096282.098890:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a883f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084469376:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1787096282.098896:0:7389:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8000/0x9eebb2eb7f50d7c6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d7cd expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.098920:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d692 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.098920:0:7389:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096282.098931:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d692 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.098938:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983881000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096282.098941:0:7389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8000/0x9eebb2eb7f50d7c6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d7cd expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.098942:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d692 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096282.098952:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787096282.098967:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d692 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.098982:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff8c7a8b27a700) 00010000:00010000:3.0:1787096282.098986:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096282.098990:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d692 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787096282.098990:0:7389:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967316 is committed 00010000:00010000:3.0:1787096282.099001:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d692 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096282.099023:0:6462:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084469376 00000020:00080000:2.0:1787096282.099025:0:7389:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8c7abf92c300 refcount 2 committed 0 result 0 batchid 5 00010000:00010000:3.0:1787096282.099031:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d83d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096282.099032:0:6462:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084469376 00000020:00080000:2.0:1787096282.099033:0:7389:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c7abd61a300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8c7abf92c780 00000020:00080000:2.0:1787096282.099044:0:7389:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].5 00010000:00010000:3.0:1787096282.099047:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d83d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099059:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d83d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096282.099060:0:7389:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c7abd61aa00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c79831d5400 00010000:00010000:3.0:1787096282.099072:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a869c8c00 already unused, calling callback (ffffffffc17594f0) 00000020:00080000:2.0:1787096282.099080:0:7389:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].5 00010000:00010000:3.0:1787096282.099090:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d83d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099098:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d83d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096282.099100:0:7389:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8c79820676c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787096282.099108:0:7389:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c7aad3b0900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8c7982067c00 00000020:00080000:2.0:1787096282.099112:0:7389:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].4 00010000:00010000:3.0:1787096282.099116:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff8c7aadca5400) 00000020:00080000:2.0:1787096282.099116:0:7389:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c7aad3b0700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c79831d4200 00010000:00010000:3.0:1787096282.099124:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096282.099127:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000020:00080000:2.0:1787096282.099128:0:7389:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].4 00010000:00010000:3.0:1787096282.099130:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d83d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099139:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d83d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096282.099146:0:6462:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a90586050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3627:x1873906084469376:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1787096282.099164:0:6462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:2.0:1787096282.099168:0:7389:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8c7aa07c83c0 refcount 2 committed 0 result 0 batchid 3 00010000:00010000:3.0:1787096282.099172:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7aa2750200/0x9eebb2eb7f50d844 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096282.099173:0:7389:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c7983393000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8c7aa07c8600 00000020:00080000:2.0:1787096282.099183:0:7389:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].3 00000020:00080000:2.0:1787096282.099190:0:7389:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c7983393100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c79832d7000 00010000:00010000:0.0:1787096282.099190:0:6462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d98d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50d986 expref: 8 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099191:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7aa2750200/0x9eebb2eb7f50d844 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096282.099198:0:7389:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].3 00000020:00080000:2.0:1787096282.099212:0:7389:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8c79831d7a80 refcount 2 committed 0 result 0 batchid 2 00010000:00010000:3.0:1787096282.099222:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7aa2750200/0x9eebb2eb7f50d844 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096282.099223:0:7389:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c7aad3b0200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8c79831d7600 00010000:00010000:0.0:1787096282.099232:0:6462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9280d55e (ffff8c7a8b27ab00) 00000020:00080000:2.0:1787096282.099233:0:7389:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].2 00000100:00100000:1.0F:1787096282.099236:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00080000:2.0:1787096282.099242:0:7389:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c7aad3b0400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c798319a000 00010000:00010000:3.0:1787096282.099244:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7aa2750200 already unused, calling callback (ffffffffc17594f0) 00000020:00080000:2.0:1787096282.099247:0:7389:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].2 00010000:00010000:0.0:1787096282.099250:0:6462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096282.099253:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7aa2750200/0x9eebb2eb7f50d844 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099261:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7aa2750200/0x9eebb2eb7f50d844 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096282.099269:0:7389:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8c7a87ed4600 refcount 2 committed 0 result 0 batchid 1 00000100:00100000:1.0:1787096282.099269:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a883f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084469504:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1787096282.099275:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8c7aadca5600) 00000020:00080000:2.0:1787096282.099279:0:7389:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c7983879200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8c7a87ed43c0 00010000:00010000:3.0:1787096282.099282:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:2.0:1787096282.099284:0:7389:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].1 00000020:00080000:2.0:1787096282.099287:0:7389:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c7983879700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c7983379200 00000020:00080000:2.0:1787096282.099290:0:7389:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].1 00000100:00100000:0.0:1787096282.099299:0:6462:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a90586050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3627:x1873906084469376:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 159us (351us total) trans 0 rc 0/0 00010000:00010000:3.0:1787096282.099300:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7aa2750200/0x9eebb2eb7f50d844 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099321:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7aa2750200/0x9eebb2eb7f50d844 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096282.099322:0:7414:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 5 committed batchid 0 00000100:00100000:0.0:1787096282.099332:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787096282.099333:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787096282.099400:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d8de lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099408:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d8de lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099414:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d8de lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099420:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a89767000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096282.099425:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d8de lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099431:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d8de lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099463:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xae2548a7 (ffff8c7aadca8e00) 00010000:00010000:3.0:1787096282.099466:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096282.099470:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d8de lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099476:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d8de lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096282.099486:0:6462:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084469504 00000100:00100000:0.0:1787096282.099492:0:6462:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084469504 00010000:00010000:3.0:1787096282.099498:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767c00/0x9eebb2eb7f50d963 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096282.099514:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a883f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084469376:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1787096282.099534:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767c00/0x9eebb2eb7f50d963 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096282.099541:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1787096282.099553:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767c00/0x9eebb2eb7f50d963 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096282.099558:0:6462:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3629:x1873906084469504:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1787096282.099575:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a89767c00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096282.099577:0:6462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096282.099579:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767c00/0x9eebb2eb7f50d963 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099588:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767c00/0x9eebb2eb7f50d963 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096282.099589:0:7414:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00010000:00010000:0.0:1787096282.099595:0:6462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813ed400/0x9eebb2eb7f50d7cd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50d7c6 expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099611:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xae2548a7 (ffff8c7aadca8e00) 00010000:00010000:3.0:1787096282.099616:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096282.099619:0:6462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff8c7a836ec400) 00010000:00010000:3.0:1787096282.099620:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767c00/0x9eebb2eb7f50d963 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099627:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767c00/0x9eebb2eb7f50d963 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.099648:0:6462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096282.099658:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813eda00/0x9eebb2eb7f50d9fd lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099666:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813eda00/0x9eebb2eb7f50d9fd lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099672:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813eda00/0x9eebb2eb7f50d9fd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099678:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a813eda00 already unused, calling callback (ffffffffc17594f0) 00000100:00100000:0.0:1787096282.099693:0:6462:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3629:x1873906084469504:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 141us (369us total) trans 0 rc 0/0 00010000:00010000:3.0:1787096282.099702:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813eda00/0x9eebb2eb7f50d9fd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096282.099707:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1787096282.099718:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813eda00/0x9eebb2eb7f50d9fd lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099731:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8c7aadca8c00) 00010000:00010000:3.0:1787096282.099733:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096282.099737:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813eda00/0x9eebb2eb7f50d9fd lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099743:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813eda00/0x9eebb2eb7f50d9fd lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099757:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813ec600/0x9eebb2eb7f50da04 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096282.099757:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a883f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084469504:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1787096282.099773:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813ec600/0x9eebb2eb7f50da04 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099779:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813ec600/0x9eebb2eb7f50da04 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099784:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a813ec600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096282.099787:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813ec600/0x9eebb2eb7f50da04 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099792:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813ec600/0x9eebb2eb7f50da04 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099799:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff8c7aadca8d00) 00010000:00010000:3.0:1787096282.099801:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096282.099817:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813ec600/0x9eebb2eb7f50da04 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099822:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813ec600/0x9eebb2eb7f50da04 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099839:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50da90 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099844:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50da90 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099850:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50da90 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099855:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82ebb400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096282.099857:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50da90 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099862:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50da90 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099868:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff8c7aadca5b00) 00010000:00010000:3.0:1787096282.099870:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096282.099872:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50da90 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.099877:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50da90 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096282.536345:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096282.536446:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077067776 00000100:00100000:0.0:1787096282.536457:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077067776 00000100:00080000:2.0:1787096282.536517:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787096282.536574:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 193 00000100:00100000:0.0:1787096282.536593:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a87947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+6:35369:x1873906077067776:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:0.0:1787096282.536615:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096282.536641:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762c00/0x9eebb2eb7f50dab3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b411a8 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.536713:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763400/0x9eebb2eb7f50daba lrc: 3/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.536729:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763400/0x9eebb2eb7f50daba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.536744:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763400/0x9eebb2eb7f50daba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096282.536843:0:6476:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x4:0x0]: returning size 4096 00000004:00200000:0.0:1787096282.536849:0:6476:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787096282.536869:0:6476:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763400/0x9eebb2eb7f50daba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.536897:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762c00/0x9eebb2eb7f50dab3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411a8 expref: 8 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.536940:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763400/0x9eebb2eb7f50daba lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411a8 expref: 7 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.536949:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8c7aadca8c00) 00010000:00010000:0.0:1787096282.536953:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787096282.536957:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd763400, rc 0) 00000100:00100000:0.0:1787096282.537027:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a87947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+7:35369:x1873906077067776:12345-192.168.201.52@tcp:101:rm.0 Request processed in 441us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096282.537036:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 193 00000100:00100000:2.0:1787096282.538242:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096282.538277:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077067904 00000100:00100000:3.0:1787096282.538282:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077067904 00000100:00100000:3.0:1787096282.538322:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 194 00000100:00100000:3.0:1787096282.538338:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+7:35369:x1873906077067904:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:3.0:1787096282.538346:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096282.538380:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50dac1 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b411af expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.538407:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50dac8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.538415:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50dac8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.538421:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50dac8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096282.538456:0:6478:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x6:0x0]: returning size 4096 00000004:00200000:3.0:1787096282.538459:0:6478:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787096282.538487:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50dac1 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411af expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.538499:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50dac8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411af expref: 8 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.538504:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff8c7aadca5b00) 00010000:00010000:3.0:1787096282.538506:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787096282.538508:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82ebb800, rc 0) 00000100:00100000:3.0:1787096282.538538:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+8:35369:x1873906077067904:12345-192.168.201.52@tcp:101:rm.0 Request processed in 203us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096282.538545:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 194 00000100:00100000:0.0:1787096282.540236:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096282.540291:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077068160 00000100:00100000:2.0:1787096282.540297:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077068160 00000100:00100000:2.0:1787096282.540337:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 195 00000100:00100000:2.0:1787096282.540389:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a87944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+8:35369:x1873906077068160:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:2.0:1787096282.540398:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096282.540416:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50dacf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b411b6 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096282.540527:0:8384:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1787096282.540601:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50dacf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411b6 expref: 10 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.540611:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c79830ed800) 00010000:00010000:2.0:1787096282.540613:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096282.540616:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50dacf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411b6 expref: 10 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.540628:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c79830eaa00, rc 0) 00000100:00100000:2.0:1787096282.540661:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a87944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+9:35369:x1873906077068160:12345-192.168.201.52@tcp:101:rm.0 Request processed in 316us (428us total) trans 4294967317 rc 301/301 00000100:00100000:2.0:1787096282.540666:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 195 00000100:00100000:0.0:1787096282.542980:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096282.543077:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077068288 00000100:00100000:1.0:1787096282.543089:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077068288 00000100:00100000:1.0:1787096282.543152:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:1.0:1787096282.543163:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aac34ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+9:35369:x1873906077068288:12345-192.168.201.52@tcp:37:rm.0 00000100:00100000:1.0:1787096282.546064:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aac34ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+9:35369:x1873906077068288:12345-192.168.201.52@tcp:37:rm.0 Request processed in 2900us (3082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096282.546076:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:1.0:1787096282.549040:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096282.549129:0:14257:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077068416 00000100:00100000:2.0:1787096282.549138:0:14257:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077068416 00000100:00080000:3.0:1787096282.549186:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096282.549211:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1787096282.549224:0:14257:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a878b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+8:35369:x1873906077068416:12345-192.168.201.52@tcp:37:rm.0 00000100:00100000:1.0:1787096282.552224:0:14257:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a878b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+8:35369:x1873906077068416:12345-192.168.201.52@tcp:37:rm.0 Request processed in 3001us (3186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096282.552235:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:1.0:1787096282.553522:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096282.553560:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077068672 00000100:00100000:2.0:1787096282.553572:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077068672 00000100:00100000:2.0:1787096282.553606:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:2.0:1787096282.553616:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c798390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+9:35369:x1873906077068672:12345-192.168.201.52@tcp:35:rm.0 00000100:00100000:2.0:1787096282.553765:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c798390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+10:35369:x1873906077068672:12345-192.168.201.52@tcp:35:rm.0 Request processed in 151us (245us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787096282.553773:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:2.0:1787096282.554713:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096282.554746:0:21727:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077068928 00000100:00100000:3.0:1787096282.554751:0:21727:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077068928 00000100:00100000:3.0:1787096282.554789:0:21727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 196 00000100:00100000:3.0:1787096282.554800:0:21727:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+10:35369:x1873906077068928:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:3.0:1787096282.554817:0:21727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096282.554840:0:21727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50dadd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b411bd expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.554938:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50dae4 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.554951:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50dae4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.554960:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50dae4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096282.554968:0:21727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1787096282.555025:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50dadd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411bd expref: 13 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.555039:0:21727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50dae4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411bd expref: 12 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.555046:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8c7aadca8c00) 00010000:00010000:3.0:1787096282.555048:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787096282.555051:0:21727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82ebac00, rc 0) 00000100:00100000:3.0:1787096282.555081:0:21727:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+12:35369:x1873906077068928:12345-192.168.201.52@tcp:101:rm.0 Request processed in 285us (369us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787096282.555096:0:21727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 196 00000100:00100000:3.0:1787096282.556138:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096282.556220:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077069056 00000100:00100000:2.0:1787096282.556226:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077069056 00000100:00100000:2.0:1787096282.556263:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 197 00000100:00100000:2.0:1787096282.556273:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+8:35369:x1873906077069056:12345-192.168.201.52@tcp:41:rm.0 00000004:00000024:2.0:1787096282.556306:0:6477:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1787096282.556348:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+8:35369:x1873906077069056:12345-192.168.201.52@tcp:41:rm.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096282.556375:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 197 00000100:00100000:1.0:1787096282.557246:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096282.557281:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077069184 00000100:00100000:3.0:1787096282.557287:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077069184 00000100:00100000:3.0:1787096282.557325:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 198 00000100:00100000:3.0:1787096282.557333:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+12:35369:x1873906077069184:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:3.0:1787096282.557344:0:10275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096282.557352:0:10275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50daf2 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b411c4 expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557413:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50daf9 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557422:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50daf9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557446:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50daf9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557461:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db00 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557467:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db00 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557473:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db00 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557534:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50db07 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557550:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50db07 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557556:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50db07 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096282.557578:0:10275:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 0 00000004:00200000:3.0:1787096282.557581:0:10275:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787096282.557591:0:10275:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50db07 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557598:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50db07 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557605:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50daf9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557610:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50daf9 lrc: 2/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557616:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50daf9 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557620:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82ebb600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096282.557623:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50daf9 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557628:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50daf9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557634:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff8c7aadca5b00) 00010000:00010000:3.0:1787096282.557643:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096282.557647:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50daf9 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557652:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50daf9 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557659:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db00 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557663:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db00 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557668:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557672:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82ebbc00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096282.557673:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557677:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557682:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff8c7aadca5400) 00010000:00010000:3.0:1787096282.557683:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096282.557685:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557688:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557705:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50daf2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411c4 expref: 14 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557724:0:10275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50db07 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411c4 expref: 13 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.557729:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8c7aadca5100) 00010000:00010000:3.0:1787096282.557731:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787096282.557733:0:10275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82ebb200, rc 0) 00000100:00100000:3.0:1787096282.557765:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+13:35369:x1873906077069184:12345-192.168.201.52@tcp:101:rm.0 Request processed in 433us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096282.557770:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 198 00000100:00100000:1.0:1787096282.558813:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096282.558876:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077069440 00000100:00100000:2.0:1787096282.558881:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077069440 00000100:00100000:2.0:1787096282.558909:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 199 00000100:00100000:2.0:1787096282.558917:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aadf2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+13:35369:x1873906077069440:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:2.0:1787096282.558940:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787096282.558952:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50db07 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411c4 expref: 13 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.558964:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8c7aadca5100) 00010000:00010000:2.0:1787096282.558973:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50dac8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411af expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.558992:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff8c7aadca5b00) 00010000:00010000:2.0:1787096282.558997:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096282.559007:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb800/0x9eebb2eb7f50db0e lrc: 3/0,1 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559014:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb800/0x9eebb2eb7f50db0e lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559020:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb800/0x9eebb2eb7f50db0e lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559028:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50db15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559034:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50db15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559039:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50db15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559074:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50db1c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559080:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50db1c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559084:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50db1c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559216:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50db23 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559231:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50db23 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559237:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50db23 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559243:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50db23 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559246:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50db23 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559250:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50db23 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559273:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787096282.559284:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50db1c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559288:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50db1c lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559291:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50db1c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559295:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830eaa00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096282.559298:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50db1c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559303:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50db1c lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559318:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8c79830ede00) 00010000:00010000:2.0:1787096282.559321:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096282.559324:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50db1c lrc: 2/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.559325:0:8374:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096282.559338:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50db1c lrc: 0/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.559342:0:8374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50db23 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559349:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb800/0x9eebb2eb7f50db0e lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.559419:0:8374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830eb600 already unused, calling callback (ffffffffc0bef6f0) 00010000:00010000:2.0:1787096282.559421:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb800/0x9eebb2eb7f50db0e lrc: 2/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.559428:0:8374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50db23 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559445:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb800/0x9eebb2eb7f50db0e lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559475:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830eb800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096282.559476:0:8374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50db23 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559479:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb800/0x9eebb2eb7f50db0e lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559488:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb800/0x9eebb2eb7f50db0e lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.559535:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff8c79830ed800) 00010000:00010000:2.0:1787096282.559540:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096282.559544:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb800/0x9eebb2eb7f50db0e lrc: 2/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.559546:0:8374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8c79830ede00) 00010000:00010000:2.0:1787096282.559562:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb800/0x9eebb2eb7f50db0e lrc: 0/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.559563:0:8374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787096282.559572:0:8374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50db23 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.559591:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50db23 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096282.559611:0:6476:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000029a6f3d reply state 000000003e3779f7 transno 4294967320 ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50db15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.559620:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096282.559624:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096282.559626:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50db15 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.559627:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096282.559638:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff8c79830ed700) 00010000:00010000:2.0:1787096282.559641:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096282.559644:0:6476:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787096282.559696:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aadf2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+13:35369:x1873906077069440:12345-192.168.201.52@tcp:36:rm.0 Request processed in 778us (885us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787096282.559703:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 199 00000100:00100000:2.0:1787096282.560690:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096282.560738:0:6464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077069568 00000100:00100000:3.0:1787096282.560744:0:6464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077069568 00000100:00100000:2.0:1787096282.560752:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096282.560811:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:3.0:1787096282.560819:0:6464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+8:2409:x1873906077069568:12345-192.168.201.52@tcp:103:rm.0 00010000:00010000:3.0:1787096282.560831:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787096282.560834:0:14257:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077069824 00000100:00100000:1.0:1787096282.560843:0:14257:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077069824 00010000:00010000:3.0:1787096282.560849:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50da3c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41177 expref: 8 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.560862:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8c7a8b27a400) 00010000:00010000:3.0:1787096282.560874:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096282.560900:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:3.0:1787096282.560907:0:6464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+7:2409:x1873906077069568:12345-192.168.201.52@tcp:103:rm.0 Request processed in 86us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096282.560915:0:14257:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+13:35369:x1873906077069824:12345-192.168.201.52@tcp:35:rm.0 00000100:00100000:3.0:1787096282.560921:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1787096282.561113:0:14257:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+14:35369:x1873906077069824:12345-192.168.201.52@tcp:35:rm.0 Request processed in 202us (360us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787096282.561120:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:3.0:1787096282.561738:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096282.561789:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077070080 00000100:00100000:0.0:1787096282.561797:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077070080 00000100:00100000:0.0:1787096282.561846:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 200 00000100:00100000:0.0:1787096282.561865:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+14:35369:x1873906077070080:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:0.0:1787096282.561901:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787096282.561917:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50dae4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411bd expref: 14 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.561938:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763400/0x9eebb2eb7f50daba lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411a8 expref: 13 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.561952:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50da4a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4117e expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.561964:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8c7aadca8c00) 00010000:00010000:0.0:1787096282.561986:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096282.562028:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.562037:0:6478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.562048:0:6478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096282.562072:0:6478:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87945880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6478:1873906084469632:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1787096282.562120:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096282.562183:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084469632 00000100:00100000:0.0:1787096282.562187:0:6478:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79833010c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096282.562189:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084469632 00000100:00100000:1.0:1787096282.562234:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787096282.562246:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6478:x1873906084469632:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787096282.562258:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096282.562271:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50db31 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50db2a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.562292:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50da20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41170 expref: 6 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.562310:0:6481:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50db31 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50db2a expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.562338:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50da20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41170 expref: 6 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.562351:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50da20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41170 expref: 6 pid: 10275 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096282.562445:0:6481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7aadf2f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6481:1873906084469760:192.168.201.52@tcp:104: 00000100:00100000:1.0:1787096282.562530:0:6481:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c798228e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096282.563183:0:6481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7aadf2f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6481:1873906084469760:192.168.201.52@tcp:104: 00010000:00010000:0.0:1787096282.563204:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50db31 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50db2a expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.563211:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:0.0:1787096282.563214:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096282.563216:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50db31 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50db2a expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.563223:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983881a00, rc 0) 00000100:00100000:0.0:1787096282.563259:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6478:x1873906084469632:12345-0@lo:101:mdt00_002.0 Request processed in 1017us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096282.563264:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787096282.563325:0:6478:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87945880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6478:1873906084469632:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1787096282.563338:0:6478:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.563377:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096282.563386:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096282.563452:0:7401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077070208 00000100:00100000:1.0:1787096282.563460:0:7401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077070208 00010000:00010000:1.0:1787096282.563488:0:7401:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50da20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41170 expref: 7 pid: 10275 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096282.563530:0:7401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:1.0:1787096282.563542:0:7401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+7:2407:x1873906077070208:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096282.563555:0:7401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096282.563562:0:7401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50da20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41170 expref: 7 pid: 10275 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.563577:0:7401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50da20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41170 expref: 7 pid: 10275 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.563598:0:7401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50da20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41170 expref: 7 pid: 10275 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.563622:0:7401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:1.0:1787096282.563628:0:7401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50db31 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50db2a expref: 6 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.563639:0:7401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50db31 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x9eebb2eb7f50db2a expref: 6 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.563649:0:7401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50db31 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x9eebb2eb7f50db2a expref: 6 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.563679:0:7401:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50db31 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50db2a expref: 6 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096282.563693:0:7401:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7aadf2d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:7401:1873906084469888:0@lo:105: 00000100:00100000:1.0:1787096282.563732:0:7401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096282.563763:0:7401:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c798228ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787096282.563775:0:8373:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084469888 00000100:00100000:0.0:1787096282.563781:0:8373:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084469888 00000100:00100000:0.0:1787096282.563821:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787096282.563828:0:8373:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aadf2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7401:x1873906084469888:12345-0@lo:105: 00010000:00010000:0.0:1787096282.563836:0:8373:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.563844:0:8373:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.563850:0:8373:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.563856:0:8373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.563861:0:8373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.563868:0:8373:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.563883:0:8373:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8c7abd763000) 00010000:00010000:3.0:1787096282.563891:0:6478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.563902:0:6478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787096282.563918:0:6478:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1787096282.563923:0:8373:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aadf2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7401:x1873906084469888:12345-0@lo:105: Request processed in 96us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096282.563931:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:3.0:1787096282.563948:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb400/0x9eebb2eb7f50db38 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.563954:0:6478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb400/0x9eebb2eb7f50db38 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.563960:0:6478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb400/0x9eebb2eb7f50db38 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096282.563972:0:7401:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7aadf2d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:7401:1873906084469888:0@lo:105: 00000100:00100000:3.0:1787096282.563976:0:6478:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7982f51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6478:1873906084470016:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787096282.564004:0:7401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787096282.564016:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096282.564041:0:7401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+6:2407:x1873906077070208:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 500us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096282.564042:0:6478:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7ac0a39d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787096282.564058:0:7401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:0.0:1787096282.564061:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084470016 00000100:00100000:0.0:1787096282.564066:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084470016 00000100:00100000:0.0:1787096282.564111:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787096282.564126:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a87945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6478:x1873906084470016:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787096282.564144:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096282.564158:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762600/0x9eebb2eb7f50db3f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50db38 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.564173:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762600/0x9eebb2eb7f50db3f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50db38 expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.564180:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762600/0x9eebb2eb7f50db3f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50db38 expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.564186:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb790e34b (ffff8c7a92eeb500) 00010000:00010000:0.0:1787096282.564188:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096282.564190:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd762600, rc 0) 00000100:00100000:0.0:1787096282.564227:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a87945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6478:x1873906084470016:12345-0@lo:101:mdt00_002.0 Request processed in 108us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096282.564233:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787096282.564245:0:6478:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7982f51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6478:1873906084470016:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1787096282.564256:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb400/0x9eebb2eb7f50db38 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50db3f expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.564263:0:6478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb400/0x9eebb2eb7f50db38 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50db3f expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787096282.564281:0:6478:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1787096282.564307:0:6478:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7982f51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6478:1873906084470144:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787096282.564329:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096282.564348:0:6478:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7ac0a39c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787096282.564853:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084470144 00000100:00100000:0.0:1787096282.564858:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084470144 00000100:00100000:0.0:1787096282.564885:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787096282.564893:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6478:x1873906084470144:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787096282.564945:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6478:x1873906084470144:12345-0@lo:1000:mdt00_002.0 Request processed in 55us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096282.564951:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787096282.564975:0:6478:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7982f51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6478:1873906084470144:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787096282.565011:0:6478:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7982f51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6478:1873906084470272:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787096282.565033:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096282.565055:0:6478:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7ac0a39c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787096282.565073:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084470272 00000100:00100000:1.0:1787096282.565080:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084470272 00000100:00100000:1.0:1787096282.565132:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787096282.565142:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:6478:x1873906084470272:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787096282.565238:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:6478:x1873906084470272:12345-0@lo:1000:mdt00_002.0 Request processed in 97us (203us total) trans 0 rc 1/1 00000100:00100000:1.0:1787096282.565257:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787096282.565268:0:6478:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7982f51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6478:1873906084470272:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787096282.565310:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82eba200/0x9eebb2eb7f50db46 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.565318:0:6478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82eba200/0x9eebb2eb7f50db46 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.565324:0:6478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82eba200/0x9eebb2eb7f50db46 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096282.565332:0:6478:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd60c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6478:1873906084470400:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1787096282.565390:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096282.565417:0:6478:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7ac0a39d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787096282.565442:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084470400 00000100:00100000:1.0:1787096282.565450:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084470400 00000100:00100000:1.0:1787096282.565486:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787096282.565494:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6478:x1873906084470400:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787096282.565502:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096282.565515:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50db4d lrc: 2/0,0 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50db46 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.565531:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50db4d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50db46 expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.565542:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50db4d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50db46 expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.565548:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8c7a8b27ad00) 00010000:00010000:1.0:1787096282.565550:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787096282.565552:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983881800, rc 0) 00000100:00100000:1.0:1787096282.565583:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6478:x1873906084470400:12345-0@lo:101:mdt00_002.0 Request processed in 92us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096282.565592:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787096282.565610:0:6478:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd60c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6478:1873906084470400:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1787096282.565623:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82eba200/0x9eebb2eb7f50db46 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50db4d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.565631:0:6478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82eba200/0x9eebb2eb7f50db46 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50db4d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.565661:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db54 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.565668:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db54 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.565674:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db54 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.565686:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50db5b lrc: 3/0,1 mode: --/EX res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.565691:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50db5b lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.565695:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50db5b lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.565712:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.565716:0:6478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.565721:0:6478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096282.565731:0:6478:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd60c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6478:1873906084470528:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1787096282.565756:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096282.565776:0:6478:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7ac0a39d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787096282.565806:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084470528 00000100:00100000:1.0:1787096282.565812:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084470528 00000100:00100000:1.0:1787096282.565863:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787096282.565876:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aad0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6478:x1873906084470528:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787096282.565886:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096282.565899:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50db69 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50db62 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.565929:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4118c expref: 5 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.565938:0:6482:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50db69 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50db62 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.565961:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4118c expref: 5 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.565973:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4118c expref: 5 pid: 21727 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096282.565985:0:6482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7aadf2d500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6482:1873906084470656:192.168.201.52@tcp:104: 00000100:00100000:1.0:1787096282.566052:0:6482:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c798228ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787096282.566726:0:6482:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7aadf2d500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6482:1873906084470656:192.168.201.52@tcp:104: 00010000:00010000:1.0:1787096282.566742:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50db69 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50db62 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.566749:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c7a8b27a300) 00010000:00010000:1.0:1787096282.566751:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787096282.566754:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50db69 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50db62 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.566760:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50db69 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50db62 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.566777:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983881200, rc 0) 00000100:00100000:1.0:1787096282.566821:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aad0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6478:x1873906084470528:12345-0@lo:101:mdt00_002.0 Request processed in 949us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096282.566828:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787096282.566861:0:6478:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd60c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6478:1873906084470528:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1787096282.566882:0:6478:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.566890:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096282.566907:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096282.566946:0:8375:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077070336 00000100:00100000:1.0:1787096282.566951:0:8375:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077070336 00010000:00010000:1.0:1787096282.566968:0:8375:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4118c expref: 6 pid: 21727 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096282.566998:0:8375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:1.0:1787096282.567005:0:8375:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+6:2406:x1873906077070336:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096282.567014:0:8375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096282.567018:0:8375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4118c expref: 6 pid: 21727 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.567026:0:8375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4118c expref: 6 pid: 21727 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.567041:0:8375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4118c expref: 6 pid: 21727 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.567052:0:8375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c7a8b27a300) 00010000:00010000:1.0:1787096282.567056:0:8375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50db69 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50db62 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.567064:0:8375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50db69 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x9eebb2eb7f50db62 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.567078:0:8375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50db69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x9eebb2eb7f50db62 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.567096:0:8375:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50db69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50db62 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096282.567107:0:8375:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7aadf2d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8375:1873906084470784:0@lo:105: 00000100:00100000:1.0:1787096282.567132:0:8375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096282.567172:0:6460:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084470784 00000100:00100000:1.0:1787096282.567174:0:8375:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c798228ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787096282.567179:0:6460:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084470784 00000100:00100000:3.0:1787096282.567212:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787096282.567218:0:6460:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aadf2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8375:x1873906084470784:12345-0@lo:105: 00010000:00010000:3.0:1787096282.567226:0:6460:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.567233:0:6460:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.567239:0:6460:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.567244:0:6460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.567249:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.567254:0:6460:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.567282:0:6460:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8c7a82ebb800) 00010000:00010000:1.0:1787096282.567317:0:6478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096282.567327:0:6478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096282.567334:0:6460:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aadf2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8375:x1873906084470784:12345-0@lo:105: Request processed in 114us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096282.567343:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787096282.567425:0:8375:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7aadf2d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8375:1873906084470784:0@lo:105: 00010000:00010000:2.0:1787096282.567454:0:8375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787096282.567498:0:8375:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2406:x1873906077070336:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 493us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096282.567505:0:8375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:1.0:1787096282.568054:0:6478:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7aadf2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6478:1873906084470912:0@lo:403:mdt00_002.0 00000100:00100000:1.0:1787096282.568104:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096282.568127:0:6478:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c798228ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787096282.568148:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084470912 00000100:00100000:2.0:1787096282.568155:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084470912 00000100:00100000:2.0:1787096282.568200:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787096282.568214:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aadf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6478:x1873906084470912:12345-0@lo:403:mdt00_002.0 00000100:00100000:2.0:1787096282.570144:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aadf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6478:x1873906084470912:12345-0@lo:403:mdt00_002.0 Request processed in 1935us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096282.570153:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787096282.570214:0:6478:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7aadf2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6478:1873906084470912:0@lo:403:mdt00_002.0 00000040:00080000:1.0:1787096282.571751:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].6, 936 off42032 00000040:00080000:1.0:1787096282.572090:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].6, 1016 off42872 00000004:00080000:1.0:1787096282.572099:0:6478:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c798228ee40 with version 9 00000004:00080000:1.0:1787096282.572124:0:7405:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7aad23da80 version 9 rpc_version 9 00000020:00100000:1.0:1787096282.572154:0:7405:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787096282.572166:0:7405:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7aadf2fb80 x1873906084471168/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2592/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787096282.572197:0:7405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7aadf2fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084471168:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096282.572251:0:7405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096282.572299:0:7405:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c798228e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787096282.572351:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084471168 00000100:00100000:3.0:1787096282.572387:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084471168 00000100:00100000:3.0:1787096282.572478:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787096282.572490:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aadf2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:7405:x1873906084471168:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096282.572871:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aadf2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:7405:x1873906084471168:12345-0@lo:1000:osp_up0-1.0 Request processed in 383us (627us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787096282.572881:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787096282.572955:0:7405:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7aadf2fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084471168:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1787096282.573022:0:6478:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1787096282.573042:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50db5b lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573050:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50db5b lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573056:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50db5b lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573063:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82ebb600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096282.573067:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50db5b lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573073:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50db5b lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573084:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff8c7aadca5800) 00010000:00010000:2.0:1787096282.573086:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096282.573090:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50db5b lrc: 2/0,0 mode: --/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573094:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50db5b lrc: 0/0,0 mode: --/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573113:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573120:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573125:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573158:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787096282.573166:0:6478:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x6:0x0] 00010000:00010000:2.0:1787096282.573175:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db54 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573184:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db54 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.573186:0:6465:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096282.573194:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573195:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db54 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.573213:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82ebb800 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:2.0:1787096282.573214:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82ebbc00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096282.573217:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db54 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573225:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db54 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.573228:0:6465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573235:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8c7aadca5e00) 00000004:00010000:0.0:1787096282.573237:0:6465:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573239:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096282.573244:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db54 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573250:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50db54 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573264:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82eba200/0x9eebb2eb7f50db46 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50db4d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.573269:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82eba200/0x9eebb2eb7f50db46 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50db4d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.573271:0:6465:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.573279:0:6465:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787096282.573286:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82eba200/0x9eebb2eb7f50db46 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50db4d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.573305:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 1/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.573311:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50db62 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50db69 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.573326:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096282.573328:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096282.573330:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096282.573342:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084471296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096282.573428:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787096282.573474:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787096282.573488:0:6478:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1787096282.573498:0:10225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084471296 00010000:00010000:3.0:1787096282.573499:0:7400:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787096282.573503:0:10225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084471296 00010000:00010000:3.0:1787096282.573506:0:7400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82eba200/0x9eebb2eb7f50db46 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x9eebb2eb7f50db4d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.573518:0:7400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82eba200 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:3.0:1787096282.573524:0:7400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82eba200/0x9eebb2eb7f50db46 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50db4d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096282.573533:0:7400:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82eba200/0x9eebb2eb7f50db46 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50db4d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096282.573541:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787096282.573552:0:10225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3629:x1873906084471296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096282.573560:0:10225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096282.573568:0:7400:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82eba200/0x9eebb2eb7f50db46 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50db4d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.573577:0:10225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50db69 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50db62 expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.573610:0:7400:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096282.573620:0:10225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c7a8b27a300) 00010000:00010000:0.0:1787096282.573639:0:10225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096282.573647:0:7400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82eba200/0x9eebb2eb7f50db46 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50db4d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096282.573657:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084471424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096282.573659:0:7400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82eba200/0x9eebb2eb7f50db46 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50db4d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096282.573684:0:10225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3629:x1873906084471296:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096282.573692:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1787096282.573695:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096282.573699:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787096282.573701:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096282.573707:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096282.573720:0:10225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084471424 00000100:00100000:0.0:1787096282.573725:0:10225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084471424 00000100:00100000:0.0:1787096282.573772:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787096282.573786:0:10225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a9017a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3626:x1873906084471424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096282.573794:0:10225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096282.573807:0:10225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50db4d lrc: 0/0,0 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50db46 expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.573823:0:10225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8c7a8b27ad00) 00010000:00010000:0.0:1787096282.573840:0:10225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787096282.573869:0:10225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a9017a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3626:x1873906084471424:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096282.573874:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787096282.573903:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084471424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096282.573923:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084471296:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096282.573931:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.573943:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.573952:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.573975:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787096282.573982:0:6478:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787096282.573991:0:6466:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096282.573995:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb400/0x9eebb2eb7f50db38 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50db3f expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.573999:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.574016:0:6478:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb400/0x9eebb2eb7f50db38 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50db3f expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.574018:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd763000 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:0.0:1787096282.574027:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096282.574051:0:6466:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.574078:0:6466:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.574085:0:6466:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787096282.574092:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+12:35369:x1873906077070080:12345-192.168.201.52@tcp:36:rm.0 Request processed in 12233us (12350us total) trans 4294967322 rc 0/0 00010000:00010000:0.0:1787096282.574107:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096282.574116:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 200 00010000:00010000:0.0:1787096282.574122:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763000/0x9eebb2eb7f50db2a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50db31 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.574137:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096282.574141:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096282.574145:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096282.574159:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084471552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096282.574209:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096282.574247:0:6462:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084471552 00000100:00100000:0.0:1787096282.574251:0:6462:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084471552 00000100:00100000:0.0:1787096282.574297:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787096282.574308:0:6462:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a90585850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3627:x1873906084471552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096282.574317:0:6462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096282.574333:0:6462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50db31 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50db2a expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.574347:0:6462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:0.0:1787096282.574640:0:6462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787096282.574672:0:6462:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a90585850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3627:x1873906084471552:12345-0@lo:103:ldlm_bl.0 Request processed in 368us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096282.574677:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787096282.574793:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084471552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096282.608545:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7aadf2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084471680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787096282.608616:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096282.608668:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084471680 00000100:00100000:1.0:1787096282.608680:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084471680 00000100:00100000:1.0:1787096282.608749:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787096282.608764:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3628:x1873906084471680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787096282.608815:0:6481:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1299980288 00000100:00100000:1.0:1787096282.608892:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3628:x1873906084471680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096282.608900:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787096282.608933:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7aadf2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084471680:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787096282.800581:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096283.047387:0:22500:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 24a: reject --ec with --comp-add ======= 19:38:02 (1787096282) 00000100:00100000:2.0:1787096283.114243:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096283.114321:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077070464 00000100:00100000:0.0:1787096283.114331:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077070464 00000100:00100000:0.0:1787096283.114401:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 201 00000100:00100000:0.0:1787096283.114411:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a9017a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+5:35541:x1873906077070464:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1787096283.114445:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096283.114463:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50db70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b411cb expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.114515:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50db77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.114528:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50db77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.114537:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50db77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096283.114573:0:8384:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787096283.114576:0:8384:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787096283.114601:0:8384:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50db77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.114620:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50db70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411cb expref: 7 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.114633:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50db77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411cb expref: 6 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.114640:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:0.0:1787096283.114643:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096283.114645:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd762200, rc 0) 00000100:00100000:0.0:1787096283.114706:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a9017a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+6:35541:x1873906077070464:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 296us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096283.114714:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 201 00000100:00100000:3.0:1787096283.115985:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096283.116051:0:21727:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077070592 00000100:00100000:0.0:1787096283.116056:0:21727:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077070592 00000100:00100000:0.0:1787096283.116087:0:21727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 202 00000100:00100000:0.0:1787096283.116093:0:21727:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+6:35541:x1873906077070592:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1787096283.116101:0:21727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096283.116108:0:21727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763600/0x9eebb2eb7f50db7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b411d2 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116137:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50db85 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116146:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50db85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116151:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50db85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116167:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50db8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116172:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50db8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116177:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50db8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116205:0:21727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50db85 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116210:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50db85 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116213:0:21727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50db85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116218:0:21727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50db85 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116222:0:21727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd763e00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096283.116225:0:21727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50db85 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116229:0:21727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50db85 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116236:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:0.0:1787096283.116237:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096283.116240:0:21727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50db85 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116249:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50db85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116257:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50db8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116260:0:21727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50db8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116264:0:21727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50db8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116268:0:21727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd762400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096283.116270:0:21727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50db8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116273:0:21727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50db8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116278:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2e9bf99 (ffff8c7a92eeb800) 00010000:00010000:0.0:1787096283.116279:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096283.116281:0:21727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50db8c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116284:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50db8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116301:0:21727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763600/0x9eebb2eb7f50db7e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411d2 expref: 7 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116316:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:0.0:1787096283.116318:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096283.116320:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763600/0x9eebb2eb7f50db7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411d2 expref: 7 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.116326:0:21727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd763600, rc 0) 00000100:00100000:0.0:1787096283.116375:0:21727:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+6:35541:x1873906077070592:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 261us (371us total) trans 0 rc 301/301 00000100:00100000:0.0:1787096283.116382:0:21727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 202 00000100:00100000:3.0:1787096283.117912:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096283.117959:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077070848 00000100:00100000:1.0:1787096283.117964:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077070848 00000100:00100000:1.0:1787096283.117996:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 203 00000100:00100000:1.0:1787096283.118005:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+6:35541:x1873906077070848:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:1.0:1787096283.118038:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096283.118051:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50db77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411cb expref: 6 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.118061:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:1.0:1787096283.118064:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096283.118089:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50db93 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.118104:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50db93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.118110:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50db93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.118136:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50db9a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.118141:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50db9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.118147:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50db9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787096283.118410:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787096283.118526:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x1:0x0].1, 64 off32832 00000004:00080000:1.0:1787096283.118534:0:6477:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8c798228ed80 with version 2 00000004:00080000:2.0:1787096283.118574:0:7977:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7a87ed4300 version 2 rpc_version 2 00000040:00080000:1.0:1787096283.118593:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787096283.118627:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x1:0x0].2, 64 off32896 00000020:00100000:2.0:1787096283.118631:0:7977:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000004:00080000:1.0:1787096283.118632:0:6477:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8c798228e480 with version 3 00000100:00100000:2.0:1787096283.118643:0:7977:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7abd5efb80 x1873906084471936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096283.118686:0:7977:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5efb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7977:1873906084471936:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787096283.118742:0:7977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096283.118787:0:7977:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7aa07c8600 going to sleep for 11 seconds 00000100:00100000:3.0:1787096283.118800:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084471936 00000100:00100000:3.0:1787096283.118806:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084471936 00000100:00100000:3.0:1787096283.118846:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787096283.118854:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:7977:x1873906084471936:12345-0@lo:1000:osp_up1-0.0 00000040:00080000:1.0:1787096283.119322:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787096283.119661:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x1:0x0].1, 64 off32832 00000040:00080000:1.0:1787096283.119887:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].1, 2152 off34920 00000040:00080000:1.0:1787096283.119971:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].1, 2352 off35120 00000004:00080000:1.0:1787096283.119976:0:6477:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8c798228e300 with version 4 00010000:00010000:2.0:1787096283.121065:0:7389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb400/0x9eebb2eb7f50db38 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50db3f expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096283.121094:0:7389:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb400/0x9eebb2eb7f50db38 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50db3f expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.121121:0:7389:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb400/0x9eebb2eb7f50db38 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50db3f expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.121130:0:7389:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787096283.121171:0:7389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb400/0x9eebb2eb7f50db38 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50db3f expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096283.121198:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084472064:0@lo:103:jbd2/dm-1-8.0 00000001:00080000:2.0:1787096283.121199:0:7389:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967323 is committed 00000001:00080000:2.0:1787096283.121218:0:7389:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967322 is committed 00000020:00080000:2.0:1787096283.121232:0:7389:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 5 batchid updated 00000100:00100000:0.0:1787096283.121243:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787096283.121252:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50db15 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787096283.121261:0:7414:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 5 00010000:00010000:3.0:1787096283.121265:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50db15 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.121273:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50db15 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.121280:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830ea600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096283.121284:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50db15 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.121292:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50db15 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787096283.121303:0:7414:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c7ab3f506c0 with version 10 00010000:00010000:3.0:1787096283.121304:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff8c79830ed700) 00010000:00010000:3.0:1787096283.121307:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096283.121312:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50db15 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787096283.121316:0:7414:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 1 cancel update log [0x200000401:0x3:0x0].1: rc = 0 00010000:00010000:3.0:1787096283.121319:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50db15 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096283.121320:0:6464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084472064 00000100:00100000:0.0:1787096283.121327:0:6464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084472064 00000100:00100000:2.0:1787096283.121351:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:7977:x1873906084471936:12345-0@lo:1000:osp_up1-0.0 Request processed in 2496us (2605us total) trans 4294967323 rc 0/0 00000020:00080000:1.0:1787096283.121403:0:7414:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 1 cancel update log [0x240000400:0x3:0x0].1: rc = 0 00000100:00100000:0.0:1787096283.121462:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787096283.121478:0:6464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3629:x1873906084472064:12345-0@lo:103:jbd2/dm-1-8.0 00000004:00080000:1.0:1787096283.121482:0:7414:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c7ab3f50f00 with version 11 00000100:00100000:2.0:1787096283.121483:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000020:00080000:1.0:1787096283.121493:0:7414:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 2 cancel update log [0x200000401:0x3:0x0].2: rc = 0 00010000:00010000:0.0:1787096283.121502:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096283.121524:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762600/0x9eebb2eb7f50db3f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50db38 expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787096283.121530:0:7414:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 2 cancel update log [0x240000400:0x3:0x0].2: rc = 0 00000004:00080000:2.0:1787096283.121552:0:7977:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00010000:00010000:0.0:1787096283.121553:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb790e34b (ffff8c7a92eeb500) 00000100:00100000:2.0:1787096283.121557:0:7977:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967323 gen 2 00010000:00010000:0.0:1787096283.121572:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1787096283.121576:0:7414:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c79831abb40 with version 12 00000100:00100000:2.0:1787096283.121580:0:7977:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5efb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7977:1873906084471936:0@lo:1000:osp_up1-0.0 00000020:00080000:1.0:1787096283.121585:0:7414:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 3 cancel update log [0x200000401:0x3:0x0].3: rc = 0 00000020:00080000:1.0:1787096283.121638:0:7414:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 3 cancel update log [0x240000400:0x3:0x0].3: rc = 0 00000004:00080000:3.0:1787096283.121646:0:7405:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7aad23da80 version 10 rpc_version 10 00000004:00080000:2.0:1787096283.121647:0:7977:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7a87ed4300 version 3 rpc_version 3 00000100:00100000:0.0:1787096283.121648:0:6464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3629:x1873906084472064:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 173us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096283.121661:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000004:00080000:1.0:1787096283.121666:0:7414:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c79831aba80 with version 13 00000020:00100000:3.0:1787096283.121668:0:7405:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:1.0:1787096283.121671:0:7414:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4 cancel update log [0x200000401:0x3:0x0].4: rc = 0 00000020:00100000:2.0:1787096283.121672:0:7977:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787096283.121677:0:7405:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7983a6b480 x1873906084472448/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096283.121684:0:7977:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7abd5efb80 x1873906084472576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:1.0:1787096283.121698:0:7414:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4 cancel update log [0x240000400:0x3:0x0].4: rc = 0 00000100:00100000:3.0:1787096283.121701:0:7405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a6b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084472448:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096283.121710:0:7977:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5efb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7977:1873906084472576:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787096283.121730:0:7414:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c79831ab840 with version 14 00000020:00080000:1.0:1787096283.121735:0:7414:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 5 cancel update log [0x200000401:0x3:0x0].5: rc = 0 00000100:00100000:3.0:1787096283.121747:0:7405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787096283.121760:0:7414:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 5 cancel update log [0x240000400:0x3:0x0].5: rc = 0 00000100:00100000:2.0:1787096283.121770:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084472448 00000020:00080000:1.0:1787096283.121771:0:7414:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787096283.121775:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084472448 00000100:00100000:0.0:1787096283.121792:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084472064:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1787096283.121794:0:7405:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7ac0a39180 going to sleep for 11 seconds 00000100:00100000:2.0:1787096283.121813:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787096283.121823:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7405:x1873906084472448:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096283.121910:0:7977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096283.121913:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7405:x1873906084472448:12345-0@lo:1000:osp_up0-1.0 Request processed in 92us (168us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1787096283.121919:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787096283.121940:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084472576 00000100:00100000:2.0:1787096283.121943:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084472576 00000100:00100000:0.0:1787096283.121961:0:7405:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a6b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084472448:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096283.121970:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000004:00080000:0.0:1787096283.121975:0:7405:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7aad23da80 version 11 rpc_version 11 00000100:00100000:2.0:1787096283.121979:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7977:x1873906084472576:12345-0@lo:1000:osp_up1-0.0 00000020:00100000:0.0:1787096283.121993:0:7405:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096283.122002:0:7405:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7abd5c3800 x1873906084472832/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096283.122007:0:7977:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7aa07c8300 going to sleep for 11 seconds 00000100:00100000:0.0:1787096283.122023:0:7405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5c3800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084472832:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096283.122065:0:7405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096283.122093:0:7405:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7983301c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787096283.122100:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084472832 00000100:00100000:1.0:1787096283.122105:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084472832 00000100:00100000:1.0:1787096283.122135:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787096283.122142:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7405:x1873906084472832:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096283.122228:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7405:x1873906084472832:12345-0@lo:1000:osp_up0-1.0 Request processed in 86us (165us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1787096283.122236:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787096283.122263:0:7405:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5c3800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084472832:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787096283.122274:0:7405:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7aad23da80 version 12 rpc_version 12 00000020:00100000:0.0:1787096283.122289:0:7405:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096283.122296:0:7405:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7abd5e8000 x1873906084473088/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096283.122313:0:7405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5e8000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084473088:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096283.122350:0:7405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096283.122408:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084473088 00000100:00100000:0.0:1787096283.122413:0:7405:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7983301c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787096283.122414:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084473088 00000100:00100000:1.0:1787096283.122472:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787096283.122480:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:7405:x1873906084473088:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096283.122564:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:7405:x1873906084473088:12345-0@lo:1000:osp_up0-1.0 Request processed in 85us (215us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787096283.122575:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787096283.122605:0:7405:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5e8000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084473088:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787096283.122613:0:7405:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7aad23da80 version 13 rpc_version 13 00000020:00100000:0.0:1787096283.122626:0:7405:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096283.122632:0:7405:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7a883f4e00 x1873906084473344/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096283.122647:0:7405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a883f4e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084473344:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096283.122685:0:7405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096283.122709:0:7405:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7983301c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787096283.122716:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084473344 00000100:00100000:1.0:1787096283.122720:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084473344 00000100:00100000:1.0:1787096283.122739:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787096283.122744:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7405:x1873906084473344:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096283.122799:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:7405:x1873906084473344:12345-0@lo:1000:osp_up0-1.0 Request processed in 55us (114us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787096283.122805:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787096283.122824:0:7405:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a883f4e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084473344:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787096283.122839:0:7405:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7aad23da80 version 14 rpc_version 14 00000020:00100000:0.0:1787096283.122851:0:7405:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096283.122856:0:7405:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7ab4f77800 x1873906084473600/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096283.122872:0:7405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f77800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084473600:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096283.122903:0:7405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096283.122924:0:7405:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7983301c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787096283.122936:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084473600 00000100:00100000:1.0:1787096283.122940:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084473600 00000100:00100000:1.0:1787096283.122957:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787096283.122962:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:7405:x1873906084473600:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096283.123014:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:7405:x1873906084473600:12345-0@lo:1000:osp_up0-1.0 Request processed in 52us (110us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787096283.123021:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787096283.123063:0:7405:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f77800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084473600:0@lo:1000:osp_up0-1.0 00000001:00080000:1.0:1787096283.124289:0:7389:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967324 is committed 00000100:00100000:2.0:1787096283.124378:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7977:x1873906084472576:12345-0@lo:1000:osp_up1-0.0 Request processed in 2400us (2468us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787096283.124384:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000004:00080000:3.0:1787096283.124404:0:7977:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787096283.124409:0:7977:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967324 gen 2 00000100:00100000:3.0:1787096283.124435:0:7977:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5efb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7977:1873906084472576:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1787096283.124473:0:7977:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7a87ed4300 version 4 rpc_version 4 00000020:00100000:3.0:1787096283.124491:0:7977:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787096283.124496:0:7977:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7983a6bb80 x1873906084473856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096283.124508:0:7977:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a6bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7977:1873906084473856:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787096283.124548:0:7977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096283.124576:0:7977:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7ac0a39840 going to sleep for 11 seconds 00000100:00100000:1.0:1787096283.124583:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084473856 00000100:00100000:1.0:1787096283.124587:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084473856 00000100:00100000:1.0:1787096283.124613:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787096283.124618:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7977:x1873906084473856:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787096283.125122:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7977:x1873906084473856:12345-0@lo:1000:osp_up1-0.0 Request processed in 501us (570us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787096283.125129:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787096283.125164:0:7977:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a6bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7977:1873906084473856:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1787096283.125222:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880c00/0x9eebb2eb7f50dba1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125231:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880c00/0x9eebb2eb7f50dba1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125242:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880c00/0x9eebb2eb7f50dba1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125254:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881600/0x9eebb2eb7f50dba8 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125259:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881600/0x9eebb2eb7f50dba8 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125264:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881600/0x9eebb2eb7f50dba8 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125282:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7983881400/0x9eebb2eb7f50dbaf lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125287:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7983881400/0x9eebb2eb7f50dbaf lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125293:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7983881400/0x9eebb2eb7f50dbaf lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096283.125302:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7aadf2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6477:1873906084473984:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1787096283.125321:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096283.125337:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831abc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787096283.125383:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084473984 00000100:00100000:2.0:1787096283.125387:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084473984 00000100:00100000:2.0:1787096283.125438:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787096283.125447:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aadf2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6477:x1873906084473984:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787096283.125455:0:7980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096283.125468:0:7980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea800/0x9eebb2eb7f50dbb6 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50dbaf expref: -99 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.125487:0:7980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea800/0x9eebb2eb7f50dbb6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50dbaf expref: 7 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.125500:0:7980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea800/0x9eebb2eb7f50dbb6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50dbaf expref: 7 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.125509:0:7980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8c7aadca8700) 00010000:00010000:2.0:1787096283.125512:0:7980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096283.125515:0:7980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c79830ea800, rc 0) 00000100:00100000:2.0:1787096283.125564:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aadf2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6477:x1873906084473984:12345-0@lo:101:mdt00_001.0 Request processed in 119us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096283.125571:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787096283.125592:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7aadf2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6477:1873906084473984:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787096283.125606:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7983881400/0x9eebb2eb7f50dbaf lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50dbb6 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125617:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7983881400/0x9eebb2eb7f50dbaf lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50dbb6 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096283.125654:0:6477:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008953f3a5 reply state 00000000d5c5de66 transno 4294967367 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881600/0x9eebb2eb7f50dba8 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125662:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881600/0x9eebb2eb7f50dba8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125666:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff8c7982e5c900) 00010000:00010000:1.0:1787096283.125669:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096283.125670:0:6477:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787096283.125674:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7983881400/0x9eebb2eb7f50dbaf lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50dbb6 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125679:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7983881400/0x9eebb2eb7f50dbaf lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50dbb6 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787096283.125685:0:6477:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x2:0x0] 00000004:00010000:1.0:1787096283.125689:0:6477:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008953f3a5 reply state 00000000d5c5de66 transno 4294967367 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880c00/0x9eebb2eb7f50dba1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125693:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880c00/0x9eebb2eb7f50dba1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125697:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8c7982e5c600) 00010000:00010000:1.0:1787096283.125699:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096283.125700:0:6477:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787096283.125702:0:6477:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x13:0x0]: returning size 4096 00010000:00010000:1.0:1787096283.125706:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50db93 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125710:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50db93 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125717:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50db93 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125722:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50db93 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125725:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983880000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096283.125727:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50db93 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125731:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50db93 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125736:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:1.0:1787096283.125737:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096283.125739:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50db93 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125743:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50db93 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096283.125749:0:6477:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008953f3a5 reply state 00000000d5c5de66 transno 4294967367 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50db9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125754:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50db9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.125758:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2e9bf99 (ffff8c7a8b27a000) 00010000:00010000:1.0:1787096283.125760:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096283.125761:0:6477:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1787096283.125800:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+7:35541:x1873906077070848:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 7796us (7888us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1787096283.125813:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 203 00000100:00100000:2.0:1787096283.134635:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096283.134699:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077070976 00000100:00100000:3.0:1787096283.134707:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077070976 00000100:00100000:3.0:1787096283.134749:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 204 00000100:00100000:3.0:1787096283.134757:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+7:35544:x1873906077070976:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1787096283.134771:0:10275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096283.134789:0:10275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dbbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b411d9 expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.134825:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50dbc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.134833:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50dbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.134840:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50dbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096283.134862:0:10275:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787096283.134864:0:10275:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787096283.134875:0:10275:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50dbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.134889:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dbbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411d9 expref: 9 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.134899:0:10275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50dbc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411d9 expref: 8 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.134905:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:3.0:1787096283.134908:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787096283.134910:0:10275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82ebb200, rc 0) 00000100:00100000:3.0:1787096283.134944:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+8:35544:x1873906077070976:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 189us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096283.134949:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 204 00000100:00100000:3.0:1787096283.135831:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096283.135875:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077071104 00000100:00100000:2.0:1787096283.135880:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077071104 00000100:00100000:2.0:1787096283.135907:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 205 00000100:00100000:2.0:1787096283.135913:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+8:35544:x1873906077071104:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1787096283.135928:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096283.135935:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50dbcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b411e0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.135965:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50dbd2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.135976:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50dbd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.135985:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50dbd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.135996:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50dbd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136005:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50dbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136010:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50dbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136052:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50dbe0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136058:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50dbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136062:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50dbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096283.136102:0:6476:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x13:0x0]: returning size 4096 00000004:00200000:2.0:1787096283.136110:0:6476:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787096283.136120:0:6476:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50dbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136128:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50dbd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136132:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50dbd2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136137:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50dbd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136141:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830eb200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096283.136143:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50dbd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136147:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50dbd2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136153:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:2.0:1787096283.136155:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096283.136157:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50dbd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136161:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50dbd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136168:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50dbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136172:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50dbd9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136183:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50dbd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136186:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830eb400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096283.136188:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50dbd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136192:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50dbd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136196:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2e9bf99 (ffff8c7a8b27a000) 00010000:00010000:2.0:1787096283.136198:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096283.136200:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50dbd9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136203:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50dbd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136217:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50dbcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411e0 expref: 10 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136225:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50dbe0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411e0 expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.136230:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8c7982e5c600) 00010000:00010000:2.0:1787096283.136231:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787096283.136233:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c79830ea600, rc 0) 00000100:00100000:2.0:1787096283.136261:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+9:35544:x1873906077071104:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 348us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096283.136272:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 205 00000100:00100000:2.0:1787096283.137067:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096283.137097:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077071232 00000100:00100000:3.0:1787096283.137101:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077071232 00000100:00100000:3.0:1787096283.137129:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 206 00000100:00100000:3.0:1787096283.137134:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+9:35544:x1873906077071232:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1787096283.137141:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096283.137148:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50dbe7 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b411e7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.137171:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50dbee lrc: 3/1,0 mode: --/PR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.137179:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50dbee lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.137185:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50dbee lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096283.137206:0:6478:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1787096283.137210:0:6478:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787096283.137231:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50dbe7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411e7 expref: 11 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.137244:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50dbee lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411e7 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.137253:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff8c7982e5c900) 00010000:00010000:3.0:1787096283.137255:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787096283.137258:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82ebb400, rc 0) 00000100:00100000:3.0:1787096283.137294:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+10:35544:x1873906077071232:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 159us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096283.137312:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 206 00000100:00100000:3.0:1787096283.137945:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096283.137989:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077071360 00000100:00100000:0.0:1787096283.137996:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077071360 00000100:00100000:0.0:1787096283.138036:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 207 00000100:00100000:0.0:1787096283.138048:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+5:35544:x1873906077071360:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1787096283.138061:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096283.138074:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763600/0x9eebb2eb7f50dbf5 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b411ee expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.138111:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50dbfc lrc: 3/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.138124:0:8384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea800/0x9eebb2eb7f50dbb6 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50dbaf expref: 6 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.138134:0:8384:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50dbfc lrc: 4/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.138165:0:8384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea800/0x9eebb2eb7f50dbb6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x9eebb2eb7f50dbaf expref: 6 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096283.138197:0:8384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f77480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8384:1873906084474112:0@lo:104: 00000100:00100000:0.0:1787096283.138237:0:8384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096283.138274:0:7399:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787096283.138285:0:7399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084474112 00000100:00100000:3.0:1787096283.138288:0:7399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084474112 00000100:00100000:0.0:1787096283.138293:0:8384:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7983301c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787096283.138321:0:7399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787096283.138328:0:7399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aad07fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8384:x1873906084474112:12345-0@lo:104: 00010000:00010000:3.0:1787096283.138337:0:7399:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7983881400/0x9eebb2eb7f50dbaf lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9eebb2eb7f50dbb6 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.138401:0:7399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787096283.138406:0:7399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aad07fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8384:x1873906084474112:12345-0@lo:104: Request processed in 79us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096283.138413:0:7399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1787096283.138439:0:6465:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096283.138448:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7983881400/0x9eebb2eb7f50dbaf lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9eebb2eb7f50dbb6 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.138460:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983881400 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:1.0:1787096283.138466:0:6465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7983881400/0x9eebb2eb7f50dbaf lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x9eebb2eb7f50dbb6 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096283.138466:0:8384:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f77480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8384:1873906084474112:0@lo:104: 00000004:00010000:1.0:1787096283.138482:0:6465:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7983881400/0x9eebb2eb7f50dbaf lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x9eebb2eb7f50dbb6 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.138491:0:8384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50dbfc lrc: 3/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.138505:0:6465:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7983881400/0x9eebb2eb7f50dbaf lrc: 2/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50dbb6 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.138512:0:6465:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787096283.138534:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7983881400/0x9eebb2eb7f50dbaf lrc: 1/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50dbb6 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.138540:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7983881400/0x9eebb2eb7f50dbaf lrc: 0/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50dbb6 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096283.138544:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7aadf2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084474240:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096283.138554:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096283.138557:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096283.138558:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096283.138580:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096283.138614:0:10225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084474240 00000100:00100000:2.0:1787096283.138618:0:10225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084474240 00010000:00010000:2.0:1787096283.138634:0:10225:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea800/0x9eebb2eb7f50dbb6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x9eebb2eb7f50dbaf expref: 7 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096283.138657:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787096283.138665:0:10225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3626:x1873906084474240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787096283.138674:0:10225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1787096283.139939:0:7389:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967325 is committed 00010000:00010000:2.0:1787096283.140004:0:10225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea800/0x9eebb2eb7f50dbb6 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x9eebb2eb7f50dbaf expref: 6 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.140016:0:10225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8c7aadca8700) 00010000:00010000:2.0:1787096283.140021:0:10225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50dbfc lrc: 3/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.140028:0:10225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50dbfc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.140033:0:10225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50dbfc lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096283.140050:0:10225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787096283.140080:0:10225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084474240:12345-0@lo:103:ldlm_bl.0 Request processed in 1418us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096283.140086:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:0.0:1787096283.140100:0:8384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50dbfc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.140110:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50dbfc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096283.140114:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7aadf2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084474240:0@lo:103:ldlm_bl.0 00000004:00200000:0.0:1787096283.140144:0:8384:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x2:0x0]: returning size 4096 00000004:00200000:0.0:1787096283.140149:0:8384:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787096283.140175:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763600/0x9eebb2eb7f50dbf5 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411ee expref: 7 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.140191:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50dbfc lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411ee expref: 6 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.140200:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8c7aadca8700) 00010000:00010000:0.0:1787096283.140203:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787096283.140206:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd762400, rc 0) 00000100:00100000:0.0:1787096283.140243:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+6:35544:x1873906077071360:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 2198us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096283.140256:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 207 00000100:00100000:0.0:1787096283.141107:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096283.141140:0:21727:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077071488 00000100:00100000:3.0:1787096283.141145:0:21727:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077071488 00000100:00100000:3.0:1787096283.141173:0:21727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 208 00000100:00100000:3.0:1787096283.141179:0:21727:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+6:35544:x1873906077071488:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1787096283.141187:0:21727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096283.141195:0:21727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50dc03 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b411f5 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141222:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dc0a lrc: 3/1,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141230:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dc0a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141245:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dc0a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141282:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50dc11 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141288:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50dc11 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141293:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50dc11 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141319:0:21727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dc0a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141324:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dc0a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141328:0:21727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dc0a lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141332:0:21727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dc0a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141335:0:21727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82ebb600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096283.141337:0:21727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dc0a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141341:0:21727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dc0a lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141346:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8c7aadca8700) 00010000:00010000:3.0:1787096283.141377:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096283.141382:0:21727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dc0a lrc: 3/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141387:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dc0a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141396:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50dc11 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141400:0:21727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50dc11 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141404:0:21727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50dc11 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141408:0:21727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82ebb800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096283.141409:0:21727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50dc11 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141413:0:21727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50dc11 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141418:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x45ad699a (ffff8c7aadca5600) 00010000:00010000:3.0:1787096283.141433:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096283.141435:0:21727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50dc11 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141439:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50dc11 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141458:0:21727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50dc03 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411f5 expref: 7 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141470:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8c7aadca8700) 00010000:00010000:3.0:1787096283.141471:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096283.141474:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50dc03 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411f5 expref: 7 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.141480:0:21727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82ebbc00, rc 0) 00000100:00100000:3.0:1787096283.141508:0:21727:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+6:35544:x1873906077071488:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 330us (403us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096283.141514:0:21727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 208 00000100:00100000:2.0:1787096283.142595:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096283.142626:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077071744 00000100:00100000:1.0:1787096283.142635:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077071744 00000100:00100000:1.0:1787096283.142663:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 209 00000100:00100000:1.0:1787096283.142670:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+6:35544:x1873906077071744:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1787096283.142678:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096283.142680:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787096283.142689:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50dbfc lrc: 0/0,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411ee expref: 6 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.142698:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8c7aadca8700) 00010000:00010000:1.0:1787096283.142704:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096283.142710:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983880000/0x9eebb2eb7f50dc18 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b411fc expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.142753:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50dc1f lrc: 3/0,1 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.142764:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50dc1f lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.142772:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50dc1f lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.142785:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881800/0x9eebb2eb7f50dc26 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x45ad699a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.142793:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881800/0x9eebb2eb7f50dc26 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.142801:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881800/0x9eebb2eb7f50dc26 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096283.142899:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7aadf2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084474368:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096283.142929:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096283.142948:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1787096283.142965:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084474368 00000100:00100000:0.0:1787096283.142970:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084474368 00000100:00100000:0.0:1787096283.142999:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787096283.143005:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aadf2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:6477:x1873906084474368:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787096283.143059:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aadf2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:6477:x1873906084474368:12345-0@lo:1000:mdt00_001.0 Request processed in 54us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096283.143064:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787096283.143083:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7aadf2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084474368:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787096283.143319:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881200/0x9eebb2eb7f50dc2d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.143327:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881200/0x9eebb2eb7f50dc2d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.143333:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881200/0x9eebb2eb7f50dc2d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096283.143340:0:6477:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 0 00010000:00010000:1.0:1787096283.143388:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50dc1f lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.143395:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50dc1f lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.143399:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50dc1f lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.143403:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50dc1f lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.143407:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983881a00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096283.143409:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50dc1f lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.143434:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50dc1f lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.143441:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8c7aa242b600) 00010000:00010000:1.0:1787096283.143443:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096283.143446:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50dc1f lrc: 3/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.143450:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50dc1f lrc: 0/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096283.143458:0:6477:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000008734833 reply state 0000000099363277 transno 4294967326 ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881800/0x9eebb2eb7f50dc26 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.143465:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881800/0x9eebb2eb7f50dc26 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.143469:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x45ad699a (ffff8c7aa242b100) 00010000:00010000:1.0:1787096283.143471:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096283.143473:0:6477:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787096283.143490:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983880000/0x9eebb2eb7f50dc18 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411fc expref: 8 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.143500:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881200/0x9eebb2eb7f50dc2d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411fc expref: 7 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096283.143504:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8c7aa242b400) 00010000:00010000:1.0:1787096283.143506:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787096283.143507:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983881200, rc 0) 00000100:00100000:1.0:1787096283.143534:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+8:35544:x1873906077071744:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 865us (940us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787096283.143544:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 209 00000100:00100000:2.0:1787096283.144885:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096283.144922:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077072000 00000100:00100000:3.0:1787096283.144927:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077072000 00000100:00100000:3.0:1787096283.144955:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 210 00000100:00100000:3.0:1787096283.144960:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+8:35544:x1873906077072000:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1787096283.144969:0:10275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096283.144976:0:10275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50dc3b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41203 expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.145018:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dc42 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.145027:0:10275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881200/0x9eebb2eb7f50dc2d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411fc expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.145033:0:10275:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dc42 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.145048:0:10275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881200/0x9eebb2eb7f50dc2d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411fc expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.145064:0:10275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881200/0x9eebb2eb7f50dc2d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411fc expref: 9 pid: 6477 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096283.145072:0:10275:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79838abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10275:1873906084474496:192.168.201.52@tcp:104: 00000100:00100000:3.0:1787096283.145112:0:10275:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7ac0a39a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787096283.145904:0:10275:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79838abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10275:1873906084474496:192.168.201.52@tcp:104: 00010000:00010000:3.0:1787096283.145918:0:10275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dc42 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096283.146075:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096283.146113:0:6462:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077072128 00000100:00100000:0.0:1787096283.146117:0:6462:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077072128 00010000:00010000:0.0:1787096283.146133:0:6462:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881200/0x9eebb2eb7f50dc2d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411fc expref: 10 pid: 6477 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096283.146158:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:0.0:1787096283.146166:0:6462:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c798380a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+10:2407:x1873906077072128:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787096283.146173:0:6462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096283.146177:0:6462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881200/0x9eebb2eb7f50dc2d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411fc expref: 10 pid: 6477 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.146186:0:6462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881200/0x9eebb2eb7f50dc2d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411fc expref: 10 pid: 6477 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.146196:0:6462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881200/0x9eebb2eb7f50dc2d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411fc expref: 10 pid: 6477 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.146214:0:6462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8c7aa242b400) 00010000:00010000:0.0:1787096283.146217:0:6462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dc42 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.146223:0:6462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dc42 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.146227:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dc42 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096283.146240:0:6462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096283.146253:0:10275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dc42 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.146260:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dc42 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096283.146268:0:6462:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c798380a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+9:2407:x1873906077072128:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 103us (192us total) trans 0 rc 0/0 00000004:00200000:3.0:1787096283.146271:0:10275:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 0 00000100:00100000:0.0:1787096283.146275:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 72 00010000:00010000:3.0:1787096283.146385:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dc42 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.146391:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dc42 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.146395:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dc42 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.146400:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82eba200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096283.146403:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dc42 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.146417:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dc42 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.146441:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8c7aa242b400) 00010000:00010000:3.0:1787096283.146482:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787096283.146487:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dc42 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.146491:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dc42 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.146510:0:10275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50dc3b lrc: 1/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41203 expref: 8 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.146516:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8c7aa242b400) 00010000:00010000:3.0:1787096283.146518:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787096283.146520:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50dc3b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41203 expref: 8 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096283.146528:0:10275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82eba400, rc 0) 00000100:00100000:3.0:1787096283.146554:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+7:35544:x1873906077072000:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1594us (1670us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096283.146559:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 210 00000100:00100000:2.0:1787096283.147411:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096283.147468:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077072384 00000100:00100000:1.0:1787096283.147472:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077072384 00000100:00100000:1.0:1787096283.147501:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:1.0:1787096283.147508:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+7:35544:x1873906077072384:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1787096283.147597:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+8:35544:x1873906077072384:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 89us (189us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1787096283.147603:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00000001:02000400:0.0:1787096283.595711:0:22549:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_24a: @@@@@@ FAIL: setstripe failed 00010000:00010000:3.0:1787096283.824476:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1380 lines, 1380 kept, 0 dropped, 0 bad.